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Abstract 



For many algorithmic problems, traditional algorithms that optimise on the number of 
instructions executed prove expensive on I/Os. Novel and very different design techniques, 
when applied to these problems, can produce algorithms that are I/O efficient. This thesis 
adds to the growing chorus of such results. The computational models we use are the 
external memory model and the W-Stream model. 

On the external memory model, we obtain the following results. (1) An I/O efficient 
algorithm for computing minimum spanning trees of graphs that improves on the perfor- 
mance of the best known algorithm. (2) The first external memory version of soft heap, an 
approximate meldable priority queue. (3) Hard heap, the first meldable external memory 
priority queue that matches the amortised I/O performance of the known external mem- 
ory priority queues, while allowing a meld operation at the same amortised cost. (4) I/O 
efficient exact, approximate and randomised algorithms for the minimum cut problem, 
which has not been explored before on the external memory model. (5) Some lower and 
upper bounds on I/Os for interval graphs. 

On the W-Stream model, we obtain the following results. (1) Algorithms for various 
tree problems and list ranking that match the performance of the best known algorithms 
and are easier to implement than them. (2) Pass efficient algorithms for sorting, and the 
maximal independent set problems, that improve on the best known algorithms. (3) Pass 
efficient algorithms for the graphs problems of finding vertex-colouring, approximate sin- 
gle source shortest paths, maximal matching, and approximate weighted vertex cover. 
(4) Lower bounds on passes for list ranking and maximal matching. 

We propose two variants of the W-Stream model, and design algorithms for the 
maximal independent set, vertex-colouring, and planar graph single source shortest paths 
problems on those models. 
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Chapter 1 



Introduction 



Over the years, computers have been used to solve larger and larger problems. Today 
we have several applications of computing that often deal with massive data sets that 
are terabytes or even petabytes in size. Examples of such applications can be found in 
databases [l9l[76], geographic information systems [9lll2], VLSI verification, computerised 
medical treatment, astrophysics, geophysics, constraint logic programming, computational 
biology, computer graphics, virtual reality, 3D simulation and modeling [6], analysis of 
telephone calls in a voice network [161 ESI [321 HTj , and transactions in a credit card network 
[T7] . to name a few. 

1.1 Memory Models 

In traditional algorithm design, it is assumed that the main memory is infinite in size and 
allows random uniform access to all its locations. This enables the designer to assume 
that all the data fits in the main memory. (Thus, traditional algorithms are often called 
"in-core".) Under these assumptions, the performance of an algorithm is decided by the 
number of instructions executed, and therefore, the design goal is to optimise it. 

These assumptions may not be valid while dealing with massive data sets, because in 
reality, the main memory is limited, and so the bulk of the data may have to be stored in 
inexpensive but slow secondary memory. The number of instructions executed would no 
longer be a reliable performance metric; but a measure of the time taken in input /output 
(I/O) communication would be. I/O communication tends to be slow because of large 
access times of secondary memories. 

1 



Computer hardware has seen significant advances in the last few decades: machines 
have become a lot faster, and the amount of main memory they have has grown. But 
the issue of the main memory being hmited has only become more relevant, because 
applications have grown even faster in size. Also, small computing devices (e.g., sensors, 
smart phones) with limited memories have found several uses. 

Caching and prefetching methods are typically designed to be general-purpose, and 
cannot take full advantage of the locality present in the computation of a problem. De- 
signing of I/O efficient algorithms has, therefore, been an actively researched area in the 
last twenty years. A host of algorithms have been designed with an intent of minimising 
the time taken in I/O. For many a problem, it has been shown that while the traditionally 
efficient algorithm is expensive on I/Os, novel and very different design techniques can 
be used to produce an algorithm that is not. This thesis makes contributions of a similar 
vein. 

We now describe some models of computations that have been used to design I/O 
efficient algorithms. 



1.1.1 The External Memory Model 

In this memory model, introduced by Aggarwal and Vitter [2], it is assumed that the bulk 
of the data is kept in the secondary memory which is a permanent storage. The secondary 
memory is divided into blocks. An input/output (I/O) is defined as the transfer of a block 
of data between the secondary memory and a volatile main memory. The processor's clock 
period and the main memory access time are negligible when compared to the secondary 
memory access time. The measure of the performance of an algorithm is the number of 
I/Os it performs. Algorithms designed on this model are referred to as external memory 
algorithms. The model defines the following parameters: the size of the problem input 
(N), the size of the main memory (M), and the size of a disk block (B). 

It has been shown that, on this model, the number of I/Os needed to read (write) 
N contiguous items from (to) the disk is Scan(A^) = Q{N/B), and that the number of 
I/Os required to sort A^ items is Sort(A^) = Q{{N/B) log j^j/siN/B)) |2|. For all reahstic 
values of A^, B, and M, Scan(A^) < Sort(A^) < A^. 



1.1.2 The Streaming Model 

This model [5l US, |66] allows the input data to be accessed sequentially, but not randomly. 
Algorithms on this model are constrained to access the data sequentially in a few passes 
from the read-only input tape, using only a small amount of working memory typically 
much smaller than the input size. Algorithms designed on this model are called streaming 
algorithms. 

The streaming model defines the following parameters: the size of the problem input 
(A^), and the size of the working memory (Mlog A^). At any one time B(M) elements can 
fit into the working memory; B(log A^) bits are needed to represent each input element. In 
a pass, the input is read sequentially by loading 0{M) elements into the working memory 
at a time. The measure of the performance of an algorithm on this model is the number 
of passes it requires. 

The read-only streaming model is very restrictive. Several problems, such as graph 
problems, are inherently difficult on the model. Therefore many extensions to this model 
have been proposed. The W-Stream model [77] is one such extension. In this model, 
an algorithm is allowed to write an intermediate stream as it reads the input stream. 
This intermediate stream, which can be a constant factor larger than the original stream, 
can be used as input for the next pass. Algorithms designed on this model are called 
W-Stream algorithms. 

1.2 Graphs 

Working with massive data sets often require analysing massive graphs. An example is the 
"call graph" on a telephone network, where a vertex corresponds to a telephone number 
and an edge to a call between two numbers during some specified time interval. Another 
example is the "web graph", where vertices are web pages and edges are links between 
web pages [32]. Moreover, many problems from widely varied domains can be reduced to 
graph problems. One example is the shortest path problem on geometric domains which is 
often solved by computing shortest paths in graphs, where a vertex is a discrete location, 
an edge is a connection between two vertices, and the weight of an edge is the geometric 
distance between the locations that correspond to its end- vertices [89] . 

A graph G = (V, E) consists of a finite nonempty set V of vertices and a set ii^ C 



V X V oi unordered pairs, called edges, of distinct vertices |11]. We shall denote \V\ 
and \E\ by V and E respectively. Two vertices u,v & V are said to be adjacent to (or 
neighbours of) each other iff [u, v) G E. The neighbourhood of vertex u (the set of m's 
neighbours) is denoted by N{u). The number of neighbours of a vertex is its degree. In a 
directed graph every edge is an ordered pair; if {u, v) G E, we say v is an out-neighbour 
of u; we will also be using the terms in-neighbour, out-degree and in-degree, which can 
be similarly defined. 

Most of the problems that we consider in this thesis are on graphs. 

1.3 Background 

In this section, we discuss some of the known upper and lower bound results that are 
relevant to our work, and are on the external memory model and variants of the streaming 
model. 

1.3.1 On the External Memory Model 

Detailed surveys of algorithmic results on the external memory model can be found in 
(621 [Ml l85] . Here we mention some results relevant to us. 

The number of I/Os needed to read (write) A^ contiguous items from (to) the disk is 
Scan(A^) = Q{N/B), and that the number of I/Os required to sort A^ items is Sort(A^) = 
QiiN/B)\ogj,,/^iN/B))l2\. 

The list ranking and 3 colouring problems on N node linked lists have I/O complex- 
ities that are 0(Sort(A^)) [20j. For many problems on trees (e.g., Euler Tour, expression 
tree evaluation) the I/O complexity is 0(Sort(A^)) [20j. For list ranking and many tree 
problems the lower bound is r2(Perm(iV)) on I/Os, where Perm(A^) is the number of I/Os 
required to permute N elements. 

The connected components problem requires Q{{E /V)SoTt{V)) I/Os [65]. This lower 
bound extends also to related problems like minimum spanning tree, biconnected com- 
ponents and ear decompositions [65]. The best known upper bound on I/Os for all these 
problems is 0(f Sort(\/) log log ^) [3 |65]. 



Results on breadth first search can be found in [HUESI- The best known upper bound 
is 0{y/{VE)/B + SoTt{E) + SF{V,E)) on I/Os [61], where SF(V,E) is the number of I/Os 



required to compute the spanning forests of a graph G = {V, E). Depth first search on an 
undirected graph can be computed in 0{V\ogV + E/Blog{E/B)) I/Os [5] 



Some restricted classes of sparse graphs, for example planar graphs, outerplanar 
graphs, grid graphs and bounded tree width graphs, have been considered in designing 
I/O efficient algorithms for single source shortest paths, depth first search, and breadth 
first search. Exploitation of the structural properties of these classes of sparse graphs has 
led to algorithms for them that perform faster than the algorithms for a general graphs. 
Most of these algorithms require 0(Sort(V + E)) I/Os [62ll8il[85]. 



1.3.2 On the Streaming Model and Its Variants 

Many data sketching and statistics problems have approximate solutions that execute in 
0(1) passes and use polylogarithmic working space on the streaming model. See [67] for a 
survey. Graph problems are hard to solve on the streaming model. Therefore, streaming 
solutions for them have tended to be on variants of the streaming model such as the 
semi-streaming [32], W-Stream [291 [77], cind streaming and sorting models [SlIT^. Most 
of the graph problems have a lower bound of Q{N/{M log N)) on passes on the W-Stream 
model [221 [2Sl SSI [77]. Connected components and minimum spanning trees, each can 
be computed in 0{N/M) passes [29]. With high probability, a maximal independent set 
can be computed in 0((A^log A^)/M) passes [28]. For the single source shortest paths 
problem, there is a monte-carlo algorithm that executes in O {{CN log N)/y/M) passes 
[29] , where C is the maximum weight of an edge. 



1.4 Summary of the Thesis 



The thesis is divided into two parts. In the first part are presented some lower and upper 
bounds results, and data structures on the external memory model. The second part of 
the thesis deals with the W-Stream model and its variants. 



1.4.1 Part I: Algorithms and Data Structures on the External 
Memory Model 

Minimum Spanning Trees 

The miniinuin spanning tree (MST) problem on an input undirected grapli G = {V,E), 
where each edge is assigned a real- valued weight, is to compute a spanning forest (a 
spanning tree for each connected component) of G so that the total weight of the edges 
in the spanning forest is a minimum. We assume that the edge weights are unique. This 
assumption is without loss of generality, because if the edge weights are not unique, then 
tagging each edge weight with the label of the corresponding edge will do to make all 
weights unique. One scan of the edgelist is sufficient for such a tagging. 

For this problem, a lower bound of r2(^Sort(\^)) on I/Os is known [65]. We present 
an I/O efficient algorithm that computes a minimum spanning tree of an undirected graph 
G = (y,E) in 0(Sort(-E) loglog^;/^ S) I/Os. The current best known upper bound on 
I/Os for this problem is 0(Sort(-E') \oglog{V B / E)) [8\. Our algorithm performs better 
than that for practically all values of V, E and B, when B ^ 16 and (B) 2 < 

E/V < (B) 2 . Our Algorithm matches the lowerbound when E/V > B^ for a 
constant e > 0. In particular, when E/V = i?*^, for a constant < e < 1, our algorithm, 
in addition to matching the lower bound, is asymptotically faster than the one by Arge 
et al. [S] by a factor of log log 5. 

Graph problems, because of their inherent lack of data localities, are not very 
amenable to efficient external memory solutions. Therefore, even a modest log log i? 
factor of improvement is significant. 

In addition to computing a minimum spanning tree, our algorithm also computes 
connected components. Therefore, our algorithm improves on the best known upper 
bound for the connected components problem too. 

External Memory Soft Heap, and Hard Heap, a Meldable Priority Queue 

A priority queue is a data structure that allows Insert, Findmin, and Deletemin opera- 
tions to execute efficiently. External memory priority queues that perform each of these 
operations in O {{1 / B) log ^,j^^{N/B)) amortized I/Os are known [71 157]. 

We present an external memory version of soft heap fT9] that we call "External 



Memory Soft Heap" (EMSH for short). It supports Insert, Findmin, Deletemin and 
Meld operations. An EMSH may, as in its in-core version, and at its discretion, corrupt 
the keys of some elements in it, by revising them upwards. But the EMSH guarantees that 
the number of corrupt elements in it is never more than eA^, where A^ is the total number 
of items inserted in it, and e is a parameter of it called the error-rate. The amortised 
I/O complexity of an Insert is ©(-^log^j/^ ^). Findmin, Deletemin and Meld all have 
non-positive amortised I/O complexities. 

This data structure is useful for finding exact and approximate medians, and for 
approximate sorting the same way it is in its in-core version [19] . Each can be computed 
in 0{N/B) I/Os. 

When we choose an error rate e < 1/A^, EMSH stays devoid of corrupt nodes, and 
thus becomes a meldable priority queue that we call "hard heap". The amortised I/O 
complexity of an Insert, in this case, is 0(-^logj^^/^ ^), over a sequence of operations 
involving A^ inserts. Findmin, Deletemin and Meld all have non-positive amortised I/O 
complexities. If the inserted keys are all unique, a Delete (by key) operation can also 
be performed at an amortised I/O complexity of 0(;^log^^/g ^). A balancing operation 
performed once in a while on a hard heap ensures that the number of I/Os performed by 
a sequence of S operations on it is 0(^ + -^ X]i=i logj\//B 13)^ where Aj is the number of 
elements in the heap before the ith operation. 

The Minimum Cut Problem 

The minimum cut problem on an undirected unweighted graph is to partition the vertices 
into two sets while minimising the number of edges from one side of the partition to 
the other. It is an important combinatorial optimisation problem. Efficient in-core and 
parallel algorithms for the problem are known. For a recent survey see [HI [521 |53l [69] . 
This problem has not been explored much from the perspective of massive data sets. 
However, it is shown in [3], [77] that a minimum cut can be computed in a polylogarithmic 
number of passes using only a polylogarithmic sized main memory on the streaming and 
sorting model. 

We show that any minimum cut algorithm requires f2(^Sort(V)) I/Os. A mini- 
mum cut algorithm is proposed that runs in 0{c{MSF{y,E)\ogE + ^Sort(V^))) I/Os, 
and performs better on dense graphs than the algorithm of [35j, which requires 0{E + 



c^VloglV/c)) I/Os, where MSF{V,E) is the number of I/Os required to compute a mini- 
mum spanning tree, and c is the value of minimum cut. Furthermore, we use this algorithm 
to construct a data structure that stores all a-mincuts (which are cuts of size at most a 
times the size of the minimum cut), where a < 3/2. The construction of the data struc- 
ture requires an additional O (Sort (A;)) I/Os, where k is the total number of a-mincuts. 
The data structure answers a query of the following form in 0{V/B) I/Os: A cut X 
(defined by a vertex partition) is given; find whether X is an a-mincut. 

Next, we show that the minimum cut problem can be computed with high probability 
in 0{c ■ MSF{V,E)\ogE + Sort(E) log^ 1/ + |Sort(V) log V) I/Os. We also present a 
(2 + e)-approximate minimum cut algorithm that requires 0{{E /V)MSF{V, E)) I/Os and 
performs better on sparse graphs than both our exact minimum cut algorithm, and the 
in-core algorithm of [35] run on the external memory model in to-to. 

Some Lower and Upper bound results on Interval Graphs 

A graph G = {V, E) is called an interval graph, if for some set S of intervals of a linearly 
ordered set, there is a bijection / : V^ — )■ 53 so that two vertices u and v are adjacent in 
G iff f{u) and f{v) overlap. Every interval graph has an interval representation in which 
endpoints are all distinct |39] . 

We show that finding the connected components in a collection of disjoint monotonic 
doubly linked lists (MLCC) of size V is equivalent to the problem (IGC) of minimally 
colouring an interval graph whose interval representation is given. The number of I/Os 
needed for both are shown to be Vt{^ log j^.j i ^ ^), where x is the chromatic number of 
an interval graph, or the total number of disjoint monotonic doubly linked lists, as is 
relevant. We also show that the 3 colouring of a doubly linked list (3LC) of size V is 
reducible to the 2 colouring of a set of disjoint monotonic doubly linked lists (2MLC) in 
0(Scan(y)+Sort(x)) I/Os. It is also shown that 2MLC and 3LC of sizes V each have lower 
bounds of Vt(^\ogj^[i^ ^) on I/Os, where x is the number of disjoint monotonic doubly 
linked lists, and the total number of forward and backward stretches in the doubly linked 
list respectively. 

We present an SSSP algorithm that requires 0(Sort(V)) I/Os, and a BFS tree com- 
putation algorithm that requires 0(Scan(V)) I/Os, and a DPS tree computation algo- 
rithm that requires 0( — Sort(x)) I/Os. The input graph is assumed to be represented 

A 



as a set of intervals in sorted order. We show that IGC can be computed in an optimal 
0(^ logjy,//^ ^) I/Os, if the input graph is represented as a set of intervals in sorted order. 
Optimal algorithms are given for 3LC, 2MLC, MLCC problems. 

1.4.2 Part II: Algorithms on the W-Stream Model and its Vari- 
ants 

Some Algorithms on the W-Stream Model 

The following results are presented. 

• Lower bounds of r2(A^/(Mlog A^)) on passes for list ranking and maximal matching. 
A lower bound for list ranking also applies to expression tree evaluation, finding the 
depth of every node of a tree, and finding the number of descendants of every node 
in a tree. 

• An algorithm that sorts N elements in 0{N/M) passes while performing 0{N log M+ 
N'^/M) comparisons and 0{N'^/M) elemental reads. Our algorithm does not use a 
simulation, and is easier to implement than the earlier algorithms. 

• Algorithms for list ranking, and tree problems such as Euler Tour, rooting of trees, 
labelling of rooted trees and expression tree evaluation that use 0{N/M) passes 
each. Unlike the previous algorithms, our algorithms are easy to implement as they 
do not use simulations. 

• Algorithms for finding a maximal independent set and a A + 1 colouring of graphs. 
We show that when the input graph is presented in an adjacency list representa- 
tion, each can be found deterministically in 0{V/M) passes. We also show that 
when the input is presented as an unordered edge list, each can be found deter- 
ministically in 0{V/x) passes, where x = 0(min{M, ^/WlogV}) for MIS, and 
X = 0(min{M, ^/MhgV, f^}) for A + 1 colouring. 

• Algorithms for maximal matching and 2-approximate weighted vertex cover that are 
deterministic and require 0{V/M) passes. The vertex cover algorithm assumes that 
the weight of each vertex is V"*^*-^'. The input here is assumed to be an unordered 



edge list. The lower bound for the maximal matching problem is shown to be 
n{V/{M\ogV)) on passes. 

An algorithm that, for all vertices v E V, computes with high probability an e- 
approximate shortest path from a given source vertex s to f in 0{ — °^ n^^ — ) passes, 



where W is the sum of the weights of the edges. We assume that log W = 0(log V). 
If C is the maximum weight of an edge, then W < VC, and our algorithm improves 
on the previous bound by a factor of C/ log{VC) at the cost a small error in accuracy. 
Here again, we assume the input to be given as an unordered edge list. 

Two Variants of the W-Stream Model and Some Algorithms on Them 

We propose two models which are variants of the W-Stream model. We give the fol- 
lowing algorithms that run on two of those models: an 0{V/M) passes maximal inde- 
pendent set algorithm and an 0{V/x) passes (A + l)-colouring algorithm,where x = 
0(min{M, y/M\ogV}), both for general graphs, and an 0{{\/V + jr) log V + -^) passes 



single source shortest paths algorithm and an 0{j^) passes all pairs shortest paths algo- 
rithm, both for planar graphs. 

1.5 Organisation of the Thesis 

The rest of the thesis is organised as follows. In chapters [2]J5] we present our results on 
external memory graph algorithms and data structures. Chapter [2] describes the improved 
result on minimum spanning tree problem. Chapter [3] describes external memory soft heap 
and hard heap. Chapter |4] describes the results on the minimum cut problem. Chapter |5] 
presents the lower bound results on ICC, 3LC, 2MLC, and MLCC. It also presents upper 
bound resuhs for 3LC, ICC, SSSP, BFS and DFS. 

In chapters |6| and [7] we present some lower and upper bounds on the W-Stream 
model and its variants. Chapter |6] describes our results on sorting, tree problems, maximal 
independent set, graph colouring, SSSP, maximal matching, and weighted vertex cover, 
all on the W-Stream model. Chapter [7] introduces two new variants of the W-Stream 
model, and then presents algorithms for the maximal independent set, A + 1-colouring 
(both on general graphs), SSSP and APSP (both on planar graphs) problems, on those 
models. 
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Part I 

Algorithms and Data Structures on 
the External Memory Model 
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Chapter 2 



Minimum Spanning Trees 



2.1 Introduction 



The computing of miniinuin spanning trees is a fundamental problem in Graph Theory 
and has been studied on various models of computation. For this problem, a lower bound 
of r2(^Sort(\^)) on I/Os is known. In this chapter, we give an I/O efficient algorithm 
that computes a minimum spanning tree of an undirected graph G = (V, E) in 0{SoTt{E) 
loglog£;/y 5) I/Os. The current best known upper bound on I/Os for this problem is 
0(Sort(-E) \oglog{V B / E)) ^. Our algorithm performs better than that for practically 
all values of V, E and B, when 5 > 16 and (B) ' 2 '"""^ < E/V < {B) ^ 2 '""'' . Our 
Algorithm matches the lowerbound when E/V > B*^ for a constant e > 0. In particular, 
when E/V = B"^, for a constant < e < 1, our algorithm, in addition to matching the 
lower bound, is asymptotically faster than the one by Arge et al. by a factor of log log B. 

Graph problems, because of their inherent lack of data localities, are not very 
amenable to efficient external memory solutions. Therefore, even a modest log log 5 
factor of improvement is significant. 

In addition to computing a minimum spanning tree, our algorithm computes con- 
nected components also. Therefore, our algorithm improves on the best known upper 
bound for the connected components problem too. 
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Problem 


I/O complexity 


Reference 


MST and CC 


0{SoTt{E)log{V/M)) 


[20J 




0{SoTt{E) log B + Scan(E) log V) 


[57] 




0{V + Sort(E)) 


m 




0{SoTt{E)\og\og{VB/E)) 


g 65] 




0(f Sort(E)) (randomised) 


U 20] 



Table 2.1: Previous upper bounds for the MST and CC problems 

2.1.1 Problem Definition 

The minimum spanning tree (MST) problem on an input undirected graph G = (y,E), 
where V and E are the vertex set and edge set respectively, and each edge is assigned a 
real- valued weight, is to compute a spanning forest (a spanning tree for each connected 
component) of G so that the total weight of the edges in the spanning forest is a minimum. 

2.1.2 Previous Results 

For the MST problem, a lower bound of Q{^SoTt(y)) on the number of I/Os is known 
[65], while the currently best known algorithm, by Arge et al. [8], executes in 0(Sort(£') 
loglog{V B / E)) 1/Os. This algorithm matches the lower bound only when E = Q{VB). 
The problems of computing connected components (CC) and minimum spanning forests 
are related. The best known upper bound for the connected components problem ^5] is 
also 0{SoTt{E) \oglog{V B / E)) . Both the connected components and minimum spanning 
tree problems can be solved by a randomised algorithm in (ySoitiV)) I/Os [I1[2Q]. Some 
of the best known upper bounds for the MST and CC problems are summarised in the 
Table O 



2.1.3 Our Results 

We propose a new MSF algorithm for undirected graphs. The I/O complexity of our 
algorithm is O (Sort (-E) log log^;/^ -B). The complexity can be improved to 0{ySoTt{V) 
loglog£;/y B), if a sparsification technique [3Uj is applied to our algorithm [HS]. Therefore, 
our algorithm matches the lower bound for the problem when E > VB^, where e > is 
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some constant. The function log logiVB/E) is 0(log log^;/^ B) only if log B — \og{E /V) < 
(log 5)/(log(E/y)), which is only if log(E/\/) > (log v^)(l + ^l - 4/(log5)) or log(E/l^) 



< (log V-B)(l - V 1 - 4/(log B)). If 5 > 16, for practically all values of V, E and B such 



-y/'-T^B ^ ^,_ ^ .„. ^+\/ 



logfl 



that (5)^ < E/l^ < (5)^ , loglog(F5/E) > loglog£;/v5, and therefore 

our algorithm performs better than that of [8j. Our Algorithm matches the lowerbound 
when E/V > B"^ for a constant e > 0. In particular, when E/V = S^, for a constant 
< e < 1, our algorithm, in addition to matching the lower bound, is asymptotically 
faster than the one by Arge et al. [Sj by a factor of log log 5. 

In addition to computing a minimum spanning tree, our algorithm computes con- 
nected components also. Therefore, our algorithm improves the upper bound for the 
connected components problem too |65] . 

2.1.4 Organisation of This Chapter 



Section 2.2 is a preliminary section in which we discuss some existing algorithms whose 



idea will be used later in our algorithm. In Section 2.3, we describe our algorithm. 



2.2 Preliminaries 

The MSF algorithms that are based on edge contraction typically proceed in a number of 
Boruvka phases [12]. In each phase the lightest edge adjacent to each vertex v is selected 
and output as part of the MSF. Then the selected edges are contracted; that is, each set of 
vertices connected by the selected edges is fused into a supervertex. Proofs of correctness 
of this approach can be found in p^ I2IH l2T| l2it 1571165] . 

Let the size of a supervertex be the number of vertices it contains from the original 
graph. An edge in the original graph between two vertices that belong to the same 
supervertex is an internal edge of the supervertex. Edges {u,v) and {u',v'), where u and 
u' end up in the same supervertex, and so do v and v' , become multiple edges. At the 
end of a Boruvka phase, the algorithms typically remove the internal edges and for each 
set of multiple edges retain only one of the lightest. 

After the i-th phase, the size of every supervertex is at least 2*, and thus after 
0(log(V"/M)) phases, the vertices in the contracted graph fit in the main memory. Once 
the vertices can fit into the main memory, the MSF can be computed in one scan of the 
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sorted edge set using the disjoint set data structure and Kruskal's algorithm [25]. Each 
Boruvka phase can be performed in 0{SoTt{E)) I/Os [H EOl [571 ES]; this results in an 
0{SoYt{E)log{V/M)) algorithm. Kumar and Schwabe [37] improved on this when they 
obtained an O (Sort (-E) log i? + Scan(_E') log V^) I/Os algorithm; they use the fact that 
after B(log-B) phases, with the number of vertices decreased to 0{V/B), a contraction 
phase can be performed more efficiently. Recently, Arge et al. [8] obtained an improved 
0{SoTt{E)loglog{VB/E)) I/Os algorithm. They use the fact that after Q{log{VB/E)) 
phases, with number of vertices decreased to E/B, a modified version of Prim's internal 
memory algorithm p5] can be used to construct an MSF in the remaining graph. 

This modified version of Prim's algorithm is also given in [S] , and works as follows: 
An external memory priority queue (EMPQ) is initialised with the edges that are incident 
to the source vertex. In each step, as in Prim's algorithm, we add to the present MSF 
the lightest border edge (an edge that connects a vertex in the present MSF to one that 
is not), and add to the EMPQ all the edges incident to the newly captured vertex. The 
EMPQ stores all the current border edges and some internal edges (edges between vertices 
in the present MSF). A delete-minimum operation on the EMPQ produces the lightest 
edge in it; it is an internal edge iff there are two copies of it in the EMPQ; discard it 
if it is an internal edge. The algorithm performs Q{E) EMPQ operations which can be 
performed in 0(Sort(_E)) I/Os [TJ [571 131] and also needs one I/O per vertex. Thus, its 
I/O complexity is 0{V + Sort(£')). When V = E/B, this is 0(Sort(E)). Note that the 
algorithm can also be used for computing connected components when an edge {u,v) is 
inserted in EMPQ with key value k = Tsim{u,v}. 

The algorithm of Arge et al. [S] performs Q{log{V B/E)) phases in a total of 0(Sort(£') 
loglog{V B/E)) I/Os. They divide the e{\og{V B/E)) phases into e{loglog{VB/E)) su- 
perphases requiring 0(Sort(£')) I/Os each and obtain the following the result: 

The minimum spanning tree of an undirected weighted graph G = {V, E) can be re- 
duced to the same problem on a graph with 0{E/B) vertices and 0{E) edges in 0{Sort{E) 
\og\og{V B/E)) I/Os. 

The i-th. superphase of their algorithm consists of [log vNi] phases, where Ni = 
2(3/2)\ ^Jq ]^q efficient, the phases in superphase i work only on a subset Ei of edges. This 
subset contains the [aZ/Vj] lightest edges incident with each vertex v. These edges are 
sufficient to perform [log vNi] phases as proved in [8], [221 [65]. Using this subset of edges, 
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each superphase is performed in 0(Sort(i5j)) = 0(Sort(_E)) I/Os. 

Combining the above with the modified Prim's algorithm, |8] presents an 0(Sort(£^) 
loglog{V B / E)) minimum spanning tree algorithm. 

Our algorithm changes the scheduling in the initial part of the algorithm of Arge et 
al. [H]. Some of ideas from Chong et al. [22J too have been used. 

2.3 Our Algorithm 

The structure of our MSF algorithm is similar to that of [8]. The first part of the algorithm 
reduces the number of vertices from V to E/B, while the second part applies the I/O 
efficient version of Prim's algorithm (see the previous section for a description) to the 
resultant graph in 0{{E/B) + Sort(E)) = 0(Sort(E)) I/Os. 

The first part of our algorithm differs from that of [8], but the second part of the two 
algorithms are identical. While we also make use of log{V B/E) phases, we schedule them 
quite differently, thereby achieving a different I/O complexity that is an improvement 
over the one of [S] for most values of V, E and B. The rest of this section describes our 
scheduling of the phases, each of which reduces the number of vertices by a factor of at 
least two, for an overall reduction by a factor of at least VB/E: from V to at most E/B. 

We assume that the edge weights are unique. This assumption is without loss of 
generality, because if the edge weights are not unique, then tagging each edge weight with 
the label of the corresponding edge will do to make all weights unique. One scan of the 
edgelist is sufficient for such a tagging. 

We assume that _E > V^ in the input graph. This assumption is without loss of 
generality, because ii E < V in G, we could add a vertex to the graph and make it 
adjacent to every other vertex with the weights of all the new edges set to oo. This can 
be done in 0(Scan(l^)) I/Os. An MST T of the resultant graph G' = {V',E') can be 
converted into an MSF for the original graph by deleting all the new edges in T. Since 
V = V + 1 andE' = E + V,we have that E' > V, ii E > 1. 

li E < V in G, alternatively, we could run Boriivka phases until the number of edges 
in the resultant graph becomes zero or exceeds the number of vertices. (The latter is 
possible if isolated supervertices are removed from the graph as soon as they form.) The 
first of those phases would run in 0(Sort(y)) I/Os. (See [8J. Also see the discussion 
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below on the first two steps of a pliase (Hook and Contract) of our algorithm.) The I/O 
cost of the subsequent phases will fall geometrically, as the number of vertices would at 
least halve in each phase. Thus, the total I/O cost too will be 0(Sort(V)). 

As mentioned before, our algorithm executes log{VB/E) Boruvka phases to reduce 
the number of vertices from V to E/B. These phases are executed in a number of stages. 
The j-th stage, j > 0, executes 2^ \og{E/V) Boruvka phases. (Note that \og{E/V) > 0.) 

Therefore, the number of Boruvka phases executed prior to the j-th stage is (2-^ — 
l)log{E/V), and the number of supervertices at the beginning of the j-th stage is at 
most \//2(^^~^)'°s'^-^/^) = E/{E/VY\ Thus, loglog^/y B stages are required to reduce the 
number of vertices to E/B. We shall show that each stage can be executed in 0{SoTt{E)) 
I/Os. Thus, the algorithm would compute the MSF in 0{SoTt{E) loglog^/y 5) I/Os. 

For j > 0, the j-th stage takes as input the graph Gj = {Vj,Ej) output by the 
previous stage. Go = (Vq, Eq), the input to the 0-th stage, is the input graph G = {V, E). 
Let g{j) = log\og{E/V)'^\ Thus the j-th stage has 2^'^^^ phases. From Ej we construct 
g{j) + 2 buckets that are numbered from to 5f(j) + 1. Each bucket is a set of edges, and 
is maintained as a sorted array with the composite (source vertex, edgeweight) as the sort 
key. In bucket Bk, < k < g{j), we store, for each vertex v G Vj, the (2^ — 1) lightest 
edges incident with v. Clearly, B/. is a subset of -Bfc+i. Bucket Bg^-^^i holds all the edges 
ofG,. 

For < A; < g{j), Bucket Bk is of size < V^(2^ — 1). Since many of the vertices 
might be of degrees smaller than (2^ — 1), the actual size of the bucket could be much 
smaller than V,(2^ ~ 1); but this is a gross upper bound. The total space used by all the 
buckets of the j-th stage is, therefore, at most 



Bg(j) + l\ < 



= 0{V,{E/vr)+0{E,) = 0{E) 

because the set of supervertices Vj number at most E/{E/V)^\ as argued earlier. 

Bucket i?g(j)+i can be formed by sorting the list of edges on the composite key 
(source vertex, edgeweight). This requires 0{SoTt{Ej)) I/Os. (Note that for each edge 
{u,v}, the list contains two entries {u,v) and {v,u) sourced at u and v respectively.) 
Next we form buckets -^^(j), . . . ,Bq in that order. For g{j) > k > 0, bucket Bk can be 





formed by scanning -Bfc+i and choosing for each vertex v E Vj, the (2^ — 1) hghtest edges 
incident with v. Clearly, this involves scanning each bucket twice, once for write and once 
for read. We do not attempt to align bucket and block boundaries. As soon as the last 
record of bucket -Bfc+i is written, we start the writing of Bk] but this requires us to start 
reading from the beginning of -Bfc+i; if we retain a copy of the block that contains the 
beginning of -B^+i in the main memory, we can do this without performing an additional 
I/O; thus the total I/O cost is proportional to the total space (in blocks) needed for all 
the buckets of the j-th stage, which is 0{Ej/B). By choosing not to align bucket and 
block boundaries, we save the one-per-bucket overhead on I/Os we would have incurred 
otherwise. 

In the j-th stage, after constructing the buckets from Ej, the algorithm performs 
2^ log{E/V) Boruvka phases. These phases in our algorithm include, in addition to the 
hook and contract operations, the clean up of an appropriate bucket and some bookkeeping 
operations. For 2 < i < 2Hog{E/V), let Gj^i = {Vj^i,Ej^i) be the graph output by the 
{i — l)-st phase; this is the input for the i-th phase. Let Gj^i = (V^',i, Ej^i) = Gj = {Vj, Ej) 
be the input for the first phase. 

A brief description of the j-th stage follows. A detailed description is given later. 

• Construct buckets -Bg(j)+i . . . Bq as described earlier. 

• iori = 1 to 2nog(E/\/) - 1, 

1. (Hook) For each vertex u G Vj^i, if Bq contains an edge incident with u (there 
can be at most one, because 2^ —1 = 1), select that edge. Let S be the set of 
the selected edges. 

2. (Contract) Compute the connected components in the graph (V^- j, S) and select 
one representative vertex for each connected component. These representatives 
form the set V^-,i+i. Construct a star graph for each connected component, with 
the representative as the root, and the other vertices of the component pointing 
to it. 

3. (Cleanup one bucket) Let f{i) = 1+ the number of trailing O's in the binary 
representation of i. Clean up -B/(i) of internal and multiple edges. 
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4. (Fill some buckets) For A; = /(?) — 1 to 0, for each supervertex w, store in bucket 
Bk some of the lightest edges ((2^ — 1) of them, if possible) incident with v. 

5. (Store the stars) Delete all the edges from bucket -B/(i) and instead store in it 
the star graphs computed from (i) the star graphs obtained in step 2 of the 
present phase and (ii) the star graphs available in buckets of lower indices. 

• Perform the last (2^*^-'^-th) Boruvka phase of the stage. In this phase, Bucket -Bg(j)+i 
is processed. But this bucket contains all the edges in the graph, and is therefore 
treated differently from the other buckets. Using the star graphs available from the 
previous phases, we clean up Bg(^j^^i of internal and multiple edges. This leaves us 
with a clean graph Gj+i = (V^+i, Ej^i) with which to begin the next stage. 

A discussion on the structure of a stage is now in order: The buckets are repeatedly 
filled and emptied over the phases. We call a bucket "full" when it contains edges, and 
"empty" when it contains star graphs, that is, information regarding the clusterings of the 
past phases. (We use the word "clustering" to denote the hook and contract operations 
performed during the course of the algorithm.) Let f{i) = 1+ the number of trailing O's in 
the binary representation of i. The i-th phase of the j-th stage, 1 < i <2^ log{E/V) — 1, 
(i) uses up the edges in bucket Bq for hooking, thereby emptying Bq, (ii) fills Bk, for all 
k < f{i), from -B/(i), and finally (iii) empties -B/(i). A simple induction, therefore, shows 
that 

for i > 1 and k > 1, bucket Bk is full at the end of the i-th phase, if and only 
if the k-th bit (with the least significant bit counted as the first) in the binary 
representation of i is 0; represents "full" and 1 represents "empty" . 

The first phase forms the basis of the induction. Prior to the first phase, at the end of 
a hypothetical 0-th phase, all buckets are full. The first phase uses up Bq, fills it from 
Bi and then empties Bi. Emptying of bucket -B/(i) and filling of all buckets of smaller 
indices is analogous to summing 1 and (i — l) using binary representations; this forms the 
induction step. 

Definition: For < A; < g{j), a A;-interval is an interval [i,i + 2^) on the real line, 
where i is a multiple of 2^. For i > 1, the /(i)-interval [i — 2^^''~^,i + 2^^'^'^) is called 
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"the interval of i" and is denoted by I{i). Note that i is the midpoint of I{i). If we 
map the i-th phase to the interval [i — l,i), then I{i) corresponds to phases numbered 

The binary representation of i has exactly f{i) — 1 trailing O's. Therefore, f{i — 
2/(*)^i) > f(i). In the {i — 2'^'^*)~^)-th phase, we empty B^ for some k > f{i), and in 
particular, fill -B/(i). All numbers between {i — 2'^^'''^) and i have less than f(i) — 1 
trailing O's. That means -B/(i) is filled in the {i — 2-'^'^*)~^)-th phase, and is never accessed 
again until the i-th phase, when it is cleaned and emptied. All numbers between i and 
{i + 2^(*)-i) have less than /(i) - 1 trailing O's. Also, f{i + 2^(*)"i) > f{i). So, in the 
{i + 2-'^'^*)~^)-th phase, we empty Bk for some k > f{i), and in particular, fill -B/(i) with 
edges taken from it. To summarise, -B/(i) is filled in the {i — 2''^*^*^^^)-th phase, emptied in 
the i-th phase and filled again in the {i + 2'^'^*)^-'^)-th phase. That is, for 1 < i < 2^^^^ — 1, 
I{i) is the interval between two successive fillings of -B/(i). 

In other words, for 1 < /c < g{j), B^ is alternately filled and emptied at intervals of 
2^-1 pj-^g^ggg j]^ particular, Bi is filled and emptied in alternate phases. Bq fulfills the role 
of a buffer that holds the lightest edge incident with every vertex that is not overgrown. 
It is filled in every step. 

Now we discuss the five steps of a phase in detail. 

Step 1: (Hook) For each vertex u G Vj^i, if Bq contains an edge incident with u 
(there can be at most one, because 2^ —1 = 1), select that edge. Let S be the set of the 
selected edges. 

Remarks on Step 1: For each (super)vertex u G Vj^i, as we shall show, if u is not 
sufficiently grown for phase i in stage j (that is, u has not grown to a size of {E/Vy^ -2*), 
then Bq contains an edge incident with u in phase i, and this is the lightest external edge 
incident with u. 

Step 2: (Contract) Compute the connected components in the graph H = {Vj^i, S) 
and select one representative vertex for each connected component. These representatives 
form the set ^.i+i. Construct a star graph for each connected component, with the 
representative as the root, and the other vertices of the component pointing to it. 

Remarks on Step 2: Each u G Vj^i has exactly one outgoing edge in iJ = (V^-,i, S). 
Also, for any two consecutive edges (m, v) and (f , w) in H, wt{u, v) > wt(f , w). Therefore, 
any cycle in H must have a size of two. Moreover, each component of iJ is a pseudo tree, 
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a connected directed graph with exactly one cycle. 

Make a copy S' of S and sort it on destination. Recall that S is sorted on source, and 
that for each u G Vj^i, there is at most one edge in S with u as the source. For {u, v) G S, 
let us call V the parent p{u) of u. Read S and S' concurrently. For each (t>, w) & S and 
each (m, f ) G S", add (m, w) into S"'. For each u such that (m, m) G S"' and u < p{u), delete 
{u,p{u)) from H and mark m as a root in H. Now iJ is a forest. 

Let H' be the underlying undirected tree of H. Form an array T as follows: For 
i > 1, ii the z-th element of array 5* is (m, v), then add (u, v, 2i + 1) and (f , m, 2i) to T as 
its {2i)-th and (2i + l)-st elements. Clearly, T is the edge list of H' . Also an edge {u,v) 
and its twin {v, u) point to each other in T. Sort T on source and destination without 
violating the twin pointers. We have obtained an adjacency list representation of H' with 
twin pointers which can be used in computing an Euler tour. 

Find an Euler tour U of H' by simulating the 0(1) time EREW PRAM algorithm 
|1H] on the external memory model |20]. For each root node r of H, delete from U the first 
edge with r as the source. Now U is a collection of disjoint linked lists. For each element 
(m, r) without a successor in U, set rank(M, r) = r, and for every other element {u,v), 
set rank(M, f) = 0. Now invoke list ranking on U, but with addition of ranks replaced 
by bitwise OR. The result gives us the connected components of U, and therefore of H. 
Each edge and therefore each vertex of H now holds a pointer to the root of the tree to 
which it belongs. 

Each connected component of H forms a supervertex. Its root shall be its represen- 
tative. Thus, we have a star graph for each supervertex. 

The purpose of steps 3, 4 and 5 is to make sure that for each supervertex v in the 
remaining graph, if v is not sufficiently grown, the lightest external edge of v is included 
in bucket Bq before the next phase. 

As we mentioned earlier, bucket -B/(i) is filled in the {i — 2'^'^*)~^)-th phase, and is 
never accessed again until the i-th phase. To clean up -B/(j), we need information regarding 
all the clustering that the algorithm has performed since then. The following lemma is 
helpful: 

Lemma 2.1. For every i, 1 < i < 2^^^\ and every I such that i < I < i + 2-'^W-i (^that 
is, I in the second half of I{i)), at the end of the l-th phase, the clustering information 
obtained from phases numbered i — 2-^^^'^^^ + 1, . . . ,i (that is, phases in the first half of 
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I{i)) is available in bucket Bf{^iy 

Proof: This can be proved by induction as follows. The case for i = 1 forms the 
basis: /(1) = 1. !</<! + 2° = 2 implies that 1 = 1. The first phase uses up Bq, fills 
it from El, empties Bi and then stores the newly found star graphs in Bi. At the end 
of the first phase, therefore, the clustering information obtained from the first phase is 
indeed available in Bi. Hence the basis. 

Hypothesise that for every i {1 <i <p — l) and every / such that i <l < i + 2-'^*^*^"^, 
at the end of the /-th phase, the clustering information obtained from i — 2-^*^*)^^ + 1 
through i is available in bucket -B/(j). 

The j9-the phase provides the induction step. 

If f{p) = 1 (and therefore p is odd), then p<l<p + 2^=p + l implies that / = p. 
The j9-th phase uses up -Bq, fills it from i?i, empties Bi and then stores the newly found 
star graphs in Bi. At the end of the p-th phase, therefore, the clustering information 
obtained from the p-th phase is indeed available in Bi. 

Suppose f{p) > 1 (and therefore p is even). For k with 1 < k < f{p), let r = 
p — 2''^^. Then /(r) = k. Since r < p, the hypothesis applies to r. Also, p — 2^^^ = 
r < p — I < r + 2^^^''^^ = p. Therefore, at the end of the {p — l)-st phase, the clustering 
information obtained from phases p — 2^^ + 1 through p — 2''^^ is available in bucket B^, 
for f{p) — 1 > k > 1. That is, all the clustering done since the last time -B/(p) was filled, 
which was in the {p — 2''^*^P)~^)-th phase, till the {p — l)-st phase is summarised in buckets 
-B/(p)_i through Bi. This, along with the star graphs formed in the p-th phase, is all the 
information that is needed to clean up -B/(p) in the p-th phase. 

In the p-th phase -B/(p) is cleaned up and the resultant star graphs are stored in it. 
These summarise all the clustering done in phases numbered (p — 2^^^^^^ + 1) through 
p. After the p-th phase, -B/(p) is accessed only in the (p + 2-^*^^^~^)-th phase. Hence the 
induction holds. D 

We now introduce the notion of thresholds. At the beginning of a stage, the threshold 
value hk{v) for supervertex v and bucket B^ is defined as follows: For a supervertex v 
with at least 2^ external edges let ek{v) denote the 2^ -th lightest external edge of v. 
Then, 

wt{ek{v)) if V has at least 2^ external edges 
hkiv) 

oo otherwise 
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Note that hk{v), when it is finite, is the weight of the hghtest external edge of v not in 
Bk] hk{v) = cxD signifies that every external edge of v is in Bk. We store hk{v) at the end 
of f 's edgelist in B^. Note that the adding of the threshold values to the end of the lists 
does not cause an asymptotic increase in the I/O complexity of bucket formation. 

Definition: A supervertex v is i-maximal if none of the supervertices formed in or 
before the i-th phase is a proper superset of v. 

Note that each supervertex at the beginning of stage j is 0-maximal. 

Definition: For a t-maximal supervertex v (where t G I{i) and 1 < i < 2^^^"^ — 1) and 
an {i — 2-^'^*''^-'^)-maximal supervertex x, x is called an (i — 2^^'^^~^)-seed of w if x has the 
smallest /i/(j) threshold among all the {i — 2'^*^*)~^)-maximal supervertices that participate 
in V. (We say that x participates in v when x C y.) 

We use rj(f ) to denote hf(^i){x), where x is an (i — 2''^*^*)~-'^)-seed of v. 

Step 3: Let /(i) = 1+ the number of trailing O's in the binary representation of i. 
Clean the edge lists of bucket -B/(i) of internal and multiple edges. Let set Xj = 0. For 
each i-maximal supervertex v, copy from -B/(j) into Xi all the external edges of v with 
weight less than rj(f). 

Remark: The cleanup operation makes use of all the clustering done since the last time 
bucket -8/(4) was clean, which was at the end of the {i — 2^^'^^~^)-th. phase. All the necessary 
information regarding past clustering is available in buckets of smaller indices. 



As described earlier in Lemma 2.1, if f(i) > 1 bucket i?/(j)_i stores the star graphs 
formed by MSF edges discovered in phases (i — 2^^^^^^) + 1 through {i — 2-^*^*)"^). Similarly 
if f{i) > 2, bucket -B/(i)-2 stores the star graphs formed in phases (i — 2^^"^^'"^) + 1 through 
(i — 2-^*^*)^^). The leaves of the stars in i?/(j)_2 are the roots of the stars in i?/(j)„i. The 
leaves of the stars in i?/(j)_3 are the roots of the stars in i?/(j)_2. Continue like this and we 
have that bucket Bi stores the star graphs formed in phase {i — 1) and the leaves of the 
stars formed in phase i are the roots of the stars in Bi. Thus, the stars in i?/(j)_i, . . . ,Bi 
along with the stars from the MSF edges computed in Step 2 of the i-th phase, form a 
forest F. 

Reduce each connected component of forest F to a star graph. Let F' denote the 
resultant forest. This is done similarly to the contraction of Step 2. Suppose F' is 
expressed as a list of edges {u,Ur), where Ur is the representative of the supervertex in 
which u participates. 
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Rename the edges of -B/(i) as follows: Sort F' on source. Sort -B/(j) on source. Read F' 
and -B/(i) concurrently. Replace each {u,v) G -B/{j) with {ur,v). Sort i?j(j) on destination. 
Read F' and -B/(j) concurrently. Replace each {u^v) G -B/(i) with (M,fr). Sort -B/(i) on the 
composite (source, destination, weight). 

Remove from -B/(i) edges of the form {u,u); these are internal edges. Also, for each 
{u,v), if -B/(j) has multiple copies of {u,v), then retain in -B/(i) only the copy with the 
smallest weight. This completes the clean up of -B/(j). This way of clean-up is well known 
in literature. (See [8], for example.) 

The stars in F' summarise all the clustering the algorithm performed in phases 
{i - 2^(^)-i + 1) through i. 

Definition: We say that a set P of edges is a minset of supervertex v, if for any two 
external edges ei and 62 of f in G with wt(ei) < wt(e2), 62 G P implies that ei G P. 

We now begin an inductive argument, which will be closed out in the remark after 
Step 4. 

Inductively assume that at the end of the {i — 2''^'^*)~^)-th phase, for each (i — 2-^'^*^"^)- 
maximal supervertex x, Bf(^i) is a minset and the threshold hf(^i){x) is a lower bound on 
the weight of the lightest external edge of x not in -B/(i). We claim that for each i- maximal 
supervertex v, Xi forms a minset. 

We prove the claim by contradiction. Suppose Xj is not a minset of v. Then, among 
the edges of G there must exist an external edge e of f such that wt(e) < rj(t>) and e ^ X^. 
Say e is an external edge of an (i — 2-^^*^~^)-maximal supervertex y that participates in 
V. Clearly, wt(e) < rj(t>) < hf(^i){y). Of the external edges of y in -B/(j), exactly those of 
weight less than rj(f) are copied into Xi. Therefore, if e ^ Xi, then e ^ -B/(j)- But then 
5/(j) is a minset of y. That is, hf(^i){y) < wt(e). Contradiction. Therefore, such an e does 
not exist. 

Note that the threshold ri[v) is a lower bound on the weight of the lightest external 
edge of V not in Xi. 

Step 4: for k = f{i) — 1 to 0, and for each supervertex v, 

- if -B/(j) has at least 2^ edges with v as the source, then copy into B^. the (2^ — 1) 
lightest of them, and set hk{v) to the weight of the 2^ -th lightest of them; 

- else copy into B^ all the edges in -B/(i) with v as the source, and set hk{v) to rj(t>). 
Remark: Clearly, for each ^-maximal supervertex v, each Bk {k < f{i)) formed in this 
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step is a minset. Also, the threshold hk{v) is a lower bound on the weight of the lightest 
external edge of v not in Bk- When we note that at the beginning of a stage, for each 
vertex v, and for each bucket B^ that forms, B^ is a minset of v, and hk{v) is the weight 
of the lightest external edge of v not in Bk, the induction we started in the remarks after 
Step 3 closes out. Thus, we have the following lemma. 

Lemma 2.2. Each freshly filled bucket is a minset for each supervertex that is maximal 
at the time of the filling. Also, for each maximal supervertex v, the threshold hk{v) is a 
lower bound on the weight of the lightest external edge of v not in B^ . 

Corollary 2.3. At the beginning of a phase, for each maximal supervertex v, if Bq con- 
tains an external edge e of v, then e is the lightest external edge of v in G. 

Step 5: Delete all the edges from bucket -B/(j) and instead store in it F', the set of 
star graphs formed during the clean up. F' is maintained as an edgelist. 

2.3.1 Correctness of the Algorithm 

Corollary 1 above proves the correctness partly. It now remains to show that every 
supervertex that is not "overgrown", will find its lightest external edge in Bq at the 
beginning of the next phase. 

For each supervertex v that has not grown to its full size and bucket Bk, we define 
the guarantee Zk{v) given by B^ on v as follows: At the beginning of the j-th stage, if 
the component in Gj that contains v has s^ vertices, then 

{2^ if V has at least 2^—1 external edges 

log s„ otherwise 

For i > 1, at the end of the i-ih. phase, for each i-maximal supervertex v, and for some 
[i — 2''^*^*^~^)-seed x of v, we set Zf[i){v) = Zf(^i){x). For each k < f{i), if -B/(j) has at least 
(2^ —1) edges with v as the source, then we set Zk{v) = i+2^; else we set Zk{v) = Zf{i-)(y). 

Lemma 2.4. Fori > 1, at the end of the i-th phase, for each k < f{i) and each i-maximal 
supervertex v that has not grown to its full size, Zk{v) > i + 2^. 

Proof. The proof is by a strong induction on i. 

The first phase forms the basis. When i = I, f{i) = /(I) = 1 and (i — 2^^"^^^^) = 0. 
In the first phase Bi is emptied. Let f be a 1-maximal supervertex that has not grown to 
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its full size. Then s^ > 4. (If 3^ = 1 then v is isolated in G, and so does not participate in 
the algorithm. If s„ is 2 or 3, then v will be grown to its full size after the first hooking.) 
Let X be a 0-seed of v. Then Zi{v) = Zi{x) > 2. Thus, Zq{v) is set to either Zi{v) or 
1 + 2° = 2. Either way, Zo{v) > 2, and hence the basis. 

Now consider the i-th phase. There are two cases. 

Case 1: f{i) < f{i — l). Clearly, i is odd, and hence f{i) = 1 and {i — 2^^^^~^) = i — 1. 
This case is similar to the basis. Bi is the bucket emptied. Let v be an i-maximal 
supervertex that has not grown to its full size, and let x be an {i — l)-seed of v. Then 
Zi{v) = Zi{x). As X is an {i — l)-maximal supervertex, and 1 < /(i — 1), we hypothesise 
that Zi{x) > {i — 1) + 2^ = i + 1. Thus, Zq{v) is set to either Zi{v) or i + 2° = i + 1. 
Either way, Zo{v) > i + 1, and the induction holds. 

Case 2: f{i) > f{i — 1), and hence i is even. We hypothesise that at the end of the 
(i — 2''^*^*''^^)-th phase, for each k < f(i — 2^^^^~^) and each (i — 2''^*^*)"^)-maximal supervertex 
X not grown to its full size, Zk{x) > i—2^^'^^^^+2''. Since, f{i) < f{i—2^'^''^^~^)^ in particular, 
Zf{i){x) > i — 2-^'^''^^^ + 2^^^"^ = i + 2^^''^~^. Let v be an i-maximal supervertex not grown to 
its full size, and let x be an (i — 2''^*^*)~^)-seed of v. Then Zf(^i^{y) = Zf(i){x) > i + 2^^^^^"^. 
Thus, for each k < f{i), Zk{v) is set to either Zfi^i){x) >i + 2'^W-i or i + 2^^. Either way, 
Zk{v) is > i + 2*^, and the induction holds. D 

Definition: For s > 0, let t, = [^\2'. For < t < 2^^^) - 1 and < A; < g{j), a 
t-maximal supervertex v is A;-stagnant if the weight of the lightest external edge of v is at 
least the hk{x), where x is the t^-seed of v. 

Note that [tk,tk + 2^) is a A;-interval. That means bucket Bk is filled in the t^-th 
phase, and is not filled again till phase tk + 2^ > t. If immediately after the formation 
of Bk in the t^-th phase, we were to cull all the external edges of v in it into an edgelist 
sorted on weights, and then were to prune this list using hk{x), then the resultant list 
would be empty. Note also that every maximal supervertex is 0-stagnant. 

Phase is a hypothetical phase prior to the first phase. Therefore, a 0-maximal 
vertex is a vertex of G, and so is a 0-seed. 

Lemma 2.5. ForO < k < g{j) and < t < 2^, ifv is a t-maximal k-stagnant supervertex 
such that X is a 0-seed of v, then size{v) > 2^^^^\ 

Proof. Let f be a t-maximal /c-stagnant supervertex such that x is a 0-seed of f , for 
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"^ k < g{j) and < t < 2^^. Here t^ = 0. That is, the hghtest external edge of v has a 
weight not less than hk{x). 

If X has at least 2—1 outgoing edges given to it in Bj. at the beginning of the stage, 
then all those edges are internal to f ; so a; and its neighbours ensure that v has a size of 
at least 2^ = 2^'''^^\ If x has less than 2^—1 outgoing edges in Bk, then hk{x) = oo, 
and hk{x') = oo for every 0-maximal x' participating in v. Thus, v has no external edge. 
Then v cannot grow anymore, and so has a size of 2^*=*^^^ = s^. D 

In the i-th phase, when we put x up into Bj. with a guarantee of Zk{v) we would 
like to say that if ever a A;-stagnant supervertex v forms with x as its i-seed, then v would 
have a size of at least 2^^'^'"\ That is what the next lemma does. 

We defined f{i) as 1+ the number of trailing O's in the binary representation of i, 
for i>l. Let /(O) be defined as g{j) + 1. 

Lemma 2.6. For each i, < i < 2^^^\ 

(1) for each i-maximal supervertex v, if v has not grown to its final size in G, then 
size{v) > 2*, and 

(2) for < k < f{i), and i <t < i + 2^ , if v is a t-maximal k-stagnant supervertex 
such that X is an i-seed of v, then size{v) > 2^''^^\ 

Proof. The proof is by induction on i. The case of i = forms the basis for (2), whereas 
the case oi i = 1 forms the basis for (1). Every 0-maximal supervertex v has a size of one. 
Lemma 4 proves (2) for i = 0. For every vertex v in Gj that is not isolated, Bq holds the 
lightest external edge of f in G at the beginning of stage j, and so v is certain to hook in 
the first phase. Thus every 1-maximal supervertex that has not grown to its final size in 
G will have a size of at least two. 

Now consider p > 0. Hypothesise that (1) is true for all i < p, and (2) is true for all 
i < p — 1. 

The Induction steps: Consider the p-th phase. After the hook and contract, -B/(p) is 
emptied and for all k < f{p), bucket B^ is filled. Suppose for t G [p,p + 2^) = I{p + 2''^^), 
a t-maximal A;-stagnant supervertex v forms. Let x be a p-seed of v. In the p-th phase, x 
is put up into B^ with a guarantee of Zk{x). Let y he a, {p — 2''^*^*')~^)-seed of x. There are 
two cases. 
Case 1: Zk{x) = Zfi^p){y). In this case, supervertex x gets all the edges from -B/(p), and 



hk{x) = hf(p){y). So, y is a {p — 2f^^^~^)-seed of v too. The lightest external edge of 
supervertex v has a weight not less than hf(^p){y) = hk{x), because otherwise v would not 
be A;-stagnant as assumed. So supervertex v is /(p)- stagnant. Also supervertex v is t- 
maximal for some t E [p,p+2'') C [p — 2^^^'~^,p+2^^^'~^). So v qualifies for an application 
of hypothesis (2) with i = p — 2-^'^^^^^ and k = f{p). Therefore, size(f ) > 2^-^(p)*-^\ But 
Z^(p)(y) = Zk{x), so size(t;) > 2^'=(-). 

Case 2: If Zk{x) ^ Zf(^p){y), then Zk{x) = p + 2^ . In this case supervertex v may not be 
/-stagnant for / > k. Supervertex x comes into B^ with 2^—1 edges. All those edges 
are internal to v. So v has a size > 2^ in terms of p-maximal supervertices. Since each 
p-maximal supervertices has size > 2"^ (by hypothesise (1)), size(f ) > 2^ ■ 2^ = 2^+^ = 

Thus (2) is proved for i = p. Note that hypothesis (2) pertains to I{p) and the 
induction step argues that (2) holds for I{p + 2'^"^) for each k < f{p). 
Now we prove statement (1) of the lemma for the {p + l)-st phase. Suppose a; is a 
{p + l)-maximal supervertex that does not grow in the {p + l)-st phase. That means x 
is 0-stagnant at the beginning of the {p + l)-st phase. That is possible only if -B/(p) has 
no edge to put up for x in Bq in the p-th phase. So x is /(p)-stagnant, and qualifies 
for an application of hypothesis (2) with i = p — 2-^^^^^^ and k = f{p). Suppose y is a 
(j) _ 2-^(*')-i)-seed of x. Then size(x) > 2^}(r')iy), 

From Lemma 3, at p — 2-^'^^^"-'^, supervertex y was put up into -B/(p) with Zf(p^{y) > 
p _ 2^(P)-1 + 2^(P) >p+l. So size(a;) > 2p+\ 

If X is a (j9 + l)-maximal supervertex that does grow in the {p + l)-st phase, then 
it has at least two p-maximal supervertices (each of size at least 2^ by hypothesis (1)) 
participating in it. So it has a size of at least 2^+^. 

We conclude that every {p+ l)-maximal supervertex has a size of at least 2^+^. Hence 
the induction. D 

This guarantees that every supervertex that has not grown to a size of 2* will indeed 
find an edge in Bq in the i-th phase. This completes the proof of correctness. 

2.3.2 The I/O Complexity of the Algorithm 

We discuss below the number of I/Os taken by each step of phase i in stage j: 

I/Os in Step 1: Since array Bq holds the edges sorted on source, S is merely a copy of 
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Bq, and so can be written out in 0(Sort(V,j)) I/Os. 

I/Os in Step 2: One step of a Parallel Random Access Machine (PRAM) that uses A^ 
processors and 0{N) space can be simulated on the external memory model in 0(Sort(A^)) 
I/Os [20]. The Euler tour of a tree of A^ vertices given in adjacency list representation 
with twin pointers can be formed in 0(1) time with 0{N) processors on an Exclusive 
Read Exclusive Write (EREW) PRAM [18]. 

If y is a permutation of an array X oi n elements, and if each element in X knows its 
position in Y, then any 0(1) amount of information that each element of X holds can be 
copied into the corresponding element of Y and vice versa in 0(1) time using n processors 
on an EREW PRAM. Therefore, if each element of X holds a pointer to another element 
of X, then these pointers can be replicated in Y in 0(1) time using n processors on an 
EREW PRAM, and hence in 0(Sort(A^)) I/Os on the external memory model. 

The list ranking algorithm of [20] when invoked on a list of size n takes 0(Sort(n)) 
I/Os. 

Putting it all together, the I/O complexity of Step 2 is therefore, O {Sort (Vj^i)). 
I/Os in Step 3: Let fofcj.i denote an upper bound on the size of bucket -B^ in phase i 
of stage j. (We define bkj^i as the product of the number of supervertices that remain in 
phase i, and 2^ — 1, the maximum degree a vertex can have in bucket k.) 

For fixed i and j, bkj^i varies as 2^ — 1 with k. Clearly, for any k, bkj,i > T.i~Qbij^i. 

Also, bij^i > 2bij^i+i, because the number supervertices that have external edges 
halves in every phase. Thus F' that summarises the clustering information in all of 
i?/(j)_i, . . . ,Bq has a size of at most &/(i)j,j_2/(0-i space. -B/(j) has a size of at most bf(^i)j^i. 
Therefore, the clean up of -B/(i) can be carried out in Sort(6j(j-)j j_2/(0-i) I/Os. 
I/Os in Step 4: Once -B/(i) has been cleaned up, for f{i) > k > 0, bucket B^. can be 
formed by scanning Bk+i and choosing for each vertex v & Vj, the (2^—1) lightest edges 
incident with v. Clearly, this involves scanning each bucket twice, once for write and once 
for read. Since the bucket sizes fall superexponentially as k falls, this can be done in 
0(6^(,),,-,/5) I/Os. 

I/Os in Step 5: The clustering information computed earlier in Step 3 is stored in -B/(j) 
in this step. The cost of this step is clearly dominated by that of Step 3. 

The total number of I/Os executed by the i-th phase of the j-th stage is therefore 
0{SoTt(yj^i) + Scan(6/(i)j,i) + Sort(6j(i)j j_2/w-i)) = OiSoitiVj^i) + Sort(6y(j) j_j_2/w-i)). 
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In the final (i.e., 2^*^-'^-th) Boriivka phase, the cleanup of bucket Bg{j)^i uses the 
clustering information from previous phases which is available in the lower numbered 
buckets. This clean up is the same as the one in step 3 and can be executed in 0(Sort(£'j)) 
I/Os. 

Therefore, the total I/O cost of the j-th stage is 

290) -I 

0(Sort(E,))+ Y. 0(Sort(V;-,) + Sort(6;(,),,,,_2/„-i)) 

5(i) (3(i)/2'')-l 

= 0(Sort(i?,)) + Y. E O(Sort(6fe,,,,.20) 

fc=0 r=0 

9{j) gij) 

= 0{SoTt{E)) + J]0(Sort(6fcjo)) = 0(Sort(E)) + ^0(Sort(\/j(22' - 1))) 

fc=0 fc=0 

which is 0(Sort(-E)). (See the discussion at the beginning of Section 3.) 

Lemma 2.7. Our algorithm performs log{V B/E) phases in 0{Sort{E) log log^^y B) I/Os. 

Proof. As argued above, the total I/O cost of the j-th stage is 0(Sort(-E)). If the to- 
tal number of stages is r, the total number of phases executed is: S^~q2^*^-'^ = [T" — 
1) \og{E /V). If this is to be logiV B / E), then r must be loglog^/^/ B. D 

Thus, we reduce the minimum spanning tree problem of an undirected graph G = 
{V,E) to the same problem on a graph with 0{E/B) vertices and 0{E) edges. On this 
new graph, the external memory version of Prim's algorithm can compute a minimum 
spanning tree in 0{E/B + Sort(-E)) I/Os. From the MSF of the reduced graph, an MSF 
of the original graph can be constructed; the I/O complexity of this will be dominated by 
the one of the reduction. 

Putting everything together, therefore. 

Theorem 2.8. Our algorithm computes a minimum spanning forest of an undirected 
graph G = {V, E) m 0{Sort{E) loglog^/y B) I/Os. 

2.4 Conclusions from this Chapter 

In this chapter we present an improved external memory algorithm for the computing of 
minimum spanning forests of graphs. Our algorithm uses a novel scheduling technique on 
the log ^ Boriivka phases needed to reduce the graph size. In our scheduling technique, 
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each bucket is emptied and filled at regular intervals. This might be restrictive, because 
at the point of emptying, a bucket may contain many more edges than are necessary to 
fill the lower numbered buckets, but all those are discarded. This slack in our scheduling 
could be exploited to design a faster algorithm. We have not yet succedded. 
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Chapter 3 

External Memory Soft Heap and 
Hard Heap, a Meldable Priority 
Queue 



3.1 Introduction 

An external memory version of soft heap that we call "External Memory Soft Heap" 
(EMSH for short) is presented. It supports Insert, Findmin, Deletemin and Meld op- 
erations. An EMSH may, as in its in-core version, and at its discretion, corrupt the keys 
of some elements in it, by revising them upwards. But the EMSH guarantees that the 
number of corrupt elements in it is never more than eA^, where A^ is the total number of 
items inserted in it, and e is a parameter of it called the error-rate. The amortised I/O 
complexity of an Insert is 0(-^log„ ^), where 171=^. Findmin, Deletemin and Meld 
all have non-positive amortised I/O complexities. 

When we choose an error rate e < 1/A^, EMSH stays devoid of corrupt nodes, and 
thus becomes a meldable priority queue that we call "hard heap". The amortised I/O 
complexity of an Insert, in this case, is 0(-^log„^), over a sequence of operations 
involving A^ inserts. Findmin, Deletemin and Meld all have non-positive amortised I/O 
complexities. If the inserted keys are all unique, a Delete (by key) operation can also 
be performed at an amortised I/O complexity of 0(;|log„^). A balancing operation 
performed once in a while on a hard heap ensures that the number of I/Os performed by 
a sequence of S operations on it is 0(^ -|- ^ X]j=i logm ^)^ where Ni is the number of 
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elements in the heap before the ith operation. 

3.1.1 Definitions 

A priority queue is a data structure used for maintaining a set S of elements, where each 
element has a key drawn from a linearly ordered set. A priority queue typically supports 
the following operations: 

1. Insert(S', x): Insert element x into S. 

2. Findmin(5'): Return the element with the smallest key in S 

3. Deletemin(S'): Return the element with the smallest key in S and remove it from 
S. 

4. Delete(5', x): Delete element x from S 

5. T)elete{S , k): Delete the element with key k from S 

Algorithmic applications of priority queues abound [H [25] . 

Soft heap is an approximate meldable priority queue devised by Chazelle [I9], and 
supports Insert, Findmin, Deletemin, Delete, and Meld operations. A soft heap, may 
at its discretion, corrupt the keys of some elements in it, by revising them upwards. A 
Findmin returns the element with the smallest current key, which may or may not be 
corrupt. A soft heap guarantees that the number of corrupt elements in it is never more 
than eA^, where A^ is the total number of items inserted in it, and e is a parameter of it 
called the error-rate. A Meld operation merges two soft heaps into one new soft heap. 

3.1.2 Previous Results 

I/O efficient priority queues have been reported before [3 [151 ED [571 [63]. An I/O efficient 
priority queue, called buffer tree was introduced by Arge [7]. A buffer tree is an (a, h) tree, 
where a = M/4 and b = M, and each node contains a buffer of size 0(M). Buffer tree 
supports the Insert, Deletemin, Delete (by key), and offline search operations. The 
amortised complexity of each of these operations on buffer tree is 0{j^ log^ %) I/Os, over 
a sequence of operations of length A^. External memory versions of heap are presented in 
[57] and [31]. The heap in pTJ is a -y/m-way tree, each node of which contains a buffer 
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of size 6(M); it supports Insert, Deletemin, and Delete (by key) operations. The 
amortised cost of each operation on this heap is 0{j^ log^ %) I/Os, where A^ is the total 
number of elements in the heap. The heap in |3I] is an m-way tree and it does not contain 
a buffer at each node. It supports Insert, and Deletemin operations. For this heap, the 
total number of I/Os performed by a sequence of S operations is 0(^ + j^ J2i=i logm i^): 
whereNi is the number of elements in the heap before the ith operation. 

An external memory version of tournament tree that supports the Deletemin, Delete 
and Update operations is also presented in [57]; this is a complete binary tree. An 
Update(x, fc) operation changes the key of element x to A; if and only if k is smaller 
than the present key of x. The amortised cost of each operation on this data structure is 
0(^log2f)I/Os[S7]. 

The priority queue of [15] maintains a hierarchy of sorted lists in secondary memory. 
An integer priority is presented in [63]. See [13] for an experimental study on some of these 
priority queues. Numerous applications of these data structure have also been reported: 
graph problems, computational geometry problems and sorting to name a few [TJ I^IFF]. 



See Table 3.1 for a comparison of hard heap with the priority queues of [3 [3ll l57] . 

Soft heap is an approximate meldable priority queue devised by Chazelle [I9], and 
supports Insert, Findmin, Deletemin, Delete, and Meld operations. This data structure 
is used in computing minimum spanning trees [IS] in the fastest known in-core algorithm 
for the problem. Soft heap has also been used for finding exact and approximate medians, 
and for approximate sorting [19]. An alternative simpler implementation of soft heap is 
given by Kaplan and Zwick |5Uj . 

3.1.3 Our Results 

In this chapter, we present an external memory version of soft heap that permits batched 
operations. We call our data structure "External Memory Soft Heap" (EMSH for short). 
As far as we know, this is the first implementation of soft heap on an external memory 
model. When we choose an error rate e < 1/A^, EMSH stays devoid of corrupt nodes, and 
thus becomes a meldable priority queue that we call "hard heap" . 

EMSH is an adaptation of soft heap for this model. It supports Insert, Findmin, 
Deletemin and Meld operations. An EMSH may, as in its in-core version, and at its 
discretion, corrupt the keys of some elements in it, by revising them upwards. But it 
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Table 3.1: Comparison with some known priority queues 

guarantees that the number of corrupt elements in it is never more than eA^, where N is 
the total number of items inserted in it, and e is a parameter of it called the error-rate. 
The amortised I/O complexity of an Insert is 0(-^log^^). Findmin, Deletemin and 
Meld all have non-positive amortised I/O complexities. 

A hard heap (an EMSH with e < 1/A^) does not have any corrupt element. Therefore, 
it is an exact meldable priority queue. The amortised I/O complexity of an Insert, in 
this case, is 0(-| log^ ^). Findmin, Deletemin and Meld all have non-positive amortised 
I/O complexities. If the inserted keys are all unique, a Delete (by key) operation can 
also be performed at an amortised I/O complexity of 0(-| log^ ^). 



3.1.4 Organisation of This Chapter 



This chapter is organised as follows: Section 3.2 describes the data structure. The cor 



rectness of the algorithm is proved in Section 3.3 The amortised I/O analysis of the 



algorithm is presented in Section 3.4, EMSH with e < 1/A^ is discussed in Section 3.5 



Some of its applications are shown in Section 3.6 
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3.2 The Data Structure 

An EMSH consists of a set of trees on disk. The nodes of the trees are classified as follows. 
A node without a child is a leaf. A node without a parent is a root. A node is internal, 
if it is neither a leaf, nor a root. 

Every non-leaf in the tree has at most ^Jm children. Nodes hold pointers to their 
children. 

Every node has a rank associated with it at the time of its creation. The rank of a 
node never changes. All children of a node of rank k are of rank A; — 1. The rank of a tree 
T is the rank of T's root. The rank of a heap H is max{rank(T) | T G i/}. An EMSH 
can have at most \fm — 1 trees of any particular rank. 

Each element held in the data structure has a key drawn from a linearly ordered set. 
We will treat an element and its key as indistinguishable. 

Each instance of EMSH has an associated error-rate e > 0. Define r = log /^ 1/e. 
Nodes of the EMSH with a rank of at most r are called pnodes (for "pure nodes"), and 
nodes with rank greater than r are called cnodes (for "corrupt nodes"). Each pnode holds 
an array that contains elements in sorted order. A tree is a ptree if its rank is at most r, 
and a ctree otherwise. 

We say that a pnode p satisfies the pnode invariant (PNI), if 



p is a non-leaf and the array in p contains at most B^pm and at least By/m/2 

elements, or 

p is a leaf and the array in p contains at most B^/m elements. 



Note that a pnode that satisfies PNI may contain less than By/m/2 elements, if it is a 
leaf. 

Every cnode has an associated doubly linked list of listnodes. A cnode holds pointers 
to the first and last listnodes of its list. The size of a list is the number of listnodes in it. 
Each listnode holds pointers to the next and previous listnodes of its list; the next (resp., 
previous) pointer of a listnode / is null if / is the last (resp., first) of its list. Each listnode 
contains at most B^/m^ and unless it is the last of a list, at least B^frnjl elements. The 
last listnode of a list may contain less than B^fmjl elements. 
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Type of node 


Number of 
children 


Number of elements in a 
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< B^/m 


> 1 
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< ^Jm 


> B,/m/2; < B^ 


> lsk/2 + IJ 


internal node 


< i/m 


> B,/m/2; < B,/m 


> [sk/2 + IJ 



Table 3.2: Types of nodes in the data structure, and the invariants on them 



Let Sk be defined as follows: 



Sk 



ii k < r 

if A; = r + 1 



[|sfc_i] iffc>r + l 

We say that a cnode c that is a non-leaf satisfies the cnode invariant (CNI), if the 
list of c has a size of at least [sfc/2j + 1. A leaf cnode always satisfies CNI. 



Table 3.2 summarizes the different types of nodes in an EMSH, the number of children 
each can have, and the PNI and CNI constraints on each. 

Every cnode has a ckey. For an element e belonging to the list of a cnode v, the ckey 
of e is the same as the ckey of f ; e is called corrupt if its ckey is greater than its key. 

An EMSH is said to satisfy the heap property if the following conditions are met: 
For every cnode v of rank greater than r + 1, the ckey of v is smaller than the ckey of 
each of f 's children. For every cnode v of rank r + 1, the ckey of v is smaller than each 
key in each of f 's children. For every pnode v, each key in v is smaller than each key in 
each of f 's children. 

For each rank i, we maintain a bucket Bi for the roots of rank i. We store the 
following information in Bf. 

1. the number of roots of rank i in the EMSH; there are at most \/m — 1 such roots. 



2. pointers to the roots of rank i in the EMSH. 

3. if 2 > r and k = min{ckey(|/) | y is a root of rank i} then a listnode of the list 
associated with the root of rank i, whose ckey value is k; this listnode will not be 
the last of the list, unless the list has only one listnode. 
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4. ii i < r then the n smallest of all elements in the roots of rank i, for some n < 



5. a pointer suffixmin[i] 

We define the minkey of a tree as follows: for a ptree T, the minkey of T is defined 
as the smallest key in the root of T; for a ctree T, the minkey of T is the ckey of the 
root of T. The minkey of a bucket Bi is the smallest of the minkeys of the trees of rank 
i in the EMSH; B^ holds pointers to the roots of these trees. The suffixmin pointer of B^ 
points to the bucket with the smallest minkey among {B^ \ x > i}. 

For each bucket, we keep the items in 1, 2 and 5 above, and at most a block of 
the elements (3 or 4 above) in the main memory. When all elements of the block are 
deleted by Deletemins, the next block is brought in. The amount of main memory 
needed for a bucket is, thus, 0{B + ^/m). As we shall show later, the maximum rank in 
the data structure, and so the number of buckets is 0(log /^(A^/i?)). Therefore, if A^ = 



0(Bm^^^'^^^^^^) the main memory suffices for all the buckets. (See Subsection 3.2.1). 

We do not keep duplicates of elements. All elements and listnodes that are taken into 
the buckets would be physically removed from the respective roots. But these elements and 
listnodes would still be thought of as belonging to their original positions. For example, 
the above definition of minkeys assumes this. 

A bucket Bi becomes empty, irrespective of the value of i, when all the elements in 
it have been deleted. 



3.2.1 The Operations 

In this section we discuss the Insert, Deletemin, Findmin, Meld, Sift and Fill-Up 
operations on EMSH. The first four are the basic operations. The last two are auxiliary. 
The Sift operation is invoked only on non-leaf nodes that fail to satisfy the pnode- 
invariant (PNI) or cnode-invariant (CNI), whichever is relevant. When the invocation 
returns, the node will satisfy the invariant. Note that PNI applies to pnodes and CNI 
applies to cnodes. Fill-Up is invoked by the other operations on a bucket when they find 
it empty. 
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Insert 

For each heap, a buffer of size By/m is maintained in the main memory. If an element e 
is to be inserted into heap H, store it in the buffer of H. The buffer stores its elements 
in sorted order of key values. If the buffer is full (that is, e is the By/m-i\i element of the 
buffer), create a new node x of rank 0, and copy all elements in the buffer into it. The 
buffer is now empty. Create a tree T of rank with x as its only node. Clearly, x is a 
root as well as a leaf. Construct a new heap H' with T as its sole tree. Create a bucket 
Bq for H\ set the number of trees in it to 1, and include a pointer to T in it. Invoke Meld 
on H and H' . 

Deletemin 

A Deletemin operation is to delete and return an element with the smallest key in 
the EMSH. The pointer suffixmin[0] points to the bucket with the smallest minkey. A 
Deletemin proceeds as in Figure |3.1[ 

Note that if after a Deletemin, a root fails to satisfy the relevant invariant, then a 
Sift is not called immediately. We wait till the next Fill-Up. (While deletions happen 
in buckets, they are counted against the root from which the deleted elements were taken. 
Therefore, a deletion can cause the corresponding root to fail the relevant invariant.) 

Recall that we keep at most a block of i?[z]'s elements in the main memory. When 
all elements of the block are deleted by Deletemins, the next block is brought in. 

Findmin 

A Findmin return the same element that a Deletemin would. But the element is not 
deleted from the EMSH. Therefore, a Findmin does not need to perform any of the 
updations that a Deletemin has to perform on the data structure. 
As it is an in-core operation, a Findmin does not incur any I/O. 

Meld 

In the Meld operation, two heaps Hi and H2 are to be merged into a new heap H. It is 
assumed that the buckets of the two heaps remain in the main memory. 

Combine the input buffers of Hi and H2. If the total number of elements exceeds 
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Let Bi be the bucket pointed by suffixniin[0]; 
let e be the smallest element in the insert buffer; 
if the key of e is smaller than the minkey of Bi then 
delete e from the insert buffer, and return e; 

if i < r then 

the element with the smallest key in the EMSH is in bucket Bi, 

let it be e; delete e from i?,; 

if Bi is not empty, then 

update its minkey value; 
else 

let X be the root of the tree T that lends its minkey to B^; the ckey of x is smaller 

than all keys in the pnodes and all ckeys; Bi holds elements from a listnode / of x; 

let e be an element from /; delete e from /; 

if Bi is empty then 

fill it up with an invocation to Fill-Up(), and update -Bj's minkey value; 

update the sufiixmin pointers of buckets Bi, . . . , Bq; 
return e; 



Figure 3.1: Deletemin 
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By/m, then create a new node x of rank 0, move By/rn elements from the buffer into it 
leaving the rest behind, create a tree T of rank with x as its only node, create a bucket 
B'q, set the number of trees in it to 1, and include a pointer to T in it. 

Let Bii (resp., i?2,i) be the i-th bucket of Hi (resp., i^2)- Let max denote the largest 
rank in the two heaps Hi and H2. The Meld is analogous to the summation of two ^/Tn- 
radix numbers of max digits. At position i, buckets Bi^i and i?2,i are the "digits"; there 
could also be a "carry-in" bucket B'^. The "summing" at position i produces a new Bi^i 
and a "carry-out" -B^+i. B'^ will function as the "carry in" for position 0. 



The Meld proceeds as in Figure 3.2 



Sift 

The Sift operation is invoked only on non-leaf nodes that fail to satisfy PNI or CNI, 
whichever is relevant. When the invocation returns, the node will satisfy the invariant. 
We shall use in the below a procedure called extract that is to be invoked only on cnodes 



of rank r + 1, and pnodes, and is defined in Figure [33 

Suppose Sift is invoked on a node x. This invocation could be recursive, or from 
Meld or Fill-Up. Meld and Fill-Up invoke Sift only on roots. Recursive invocations 
of Sift proceed top-down; thus, any recursive invocation of Sift on x must be from the 
parent of x. Also, as can be seen from the below, as soon as a non-root fails its relevant 
invariant (PNI or CNI), Sift is invoked on it. Therefore, at the beginning of a Sift on 
X, each child of x must satisfy PNI or CNI, as is relevant. 

If X is a pnode (and thus, PNI is the invariant violated), then x contains less 
than B^fmj^ elements. Each child of x satisfies PNI, and therefore has, unless it is a 
leaf, at least By/m/2 elements. Invoke extract (x). This can be done in 0{y/rn) I/Os 
by performing a Y^m-way merge of x's children's arrays. For each non-leaf child y of 
X that now violates PNI, recursively invoke Sift(|/). Now the size of x is in the range 
[B^/m/2, B^/m\, unless all of x's children are empty leaves. 

If a; is a cnode of rank r + 1, then CNI is the invariant violated. The children 
of X are of rank r, and are thus pnodes. There are two possibilities: (A) This Sift was 
invoked from a Fill-Up or Meld, and thus x has one listnode / left in it. (B) This Sift 
was invoked recursively, and thus x has no listnode left in it. In either case, to begin with, 
invoke extract(x), and invoke Sif t(y) for each non-leaf child y oi x that now violates PNI. 
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for i = to max+1 
begin 

if only one of Bii, i?2,i and B'- exists then 

that bucket becomes Bi^i] Fill-Up that bucket, if necessary; 
there is no carry-out; 
else 

ii i < r 

if Bi^i (resp., -82,1) contains elements then 

send the elements of Bii (resp., -82,4) back to the 
roots from which they were taken; 
for each root x pointed by Bi^i or i?2,j 

if X does not satisfy PNI, invoke Sif t(x); 
else 

if Bi^i (resp., -82,1) and the last listnode li (resp., ^2) 

of the root Xi (resp., X2) with the smallest ckey in Bi^i (resp., -82,1) 

have sizes < B^Jmjl each, then 

merge the elements in Bxi (resp., B^^i) into l\ (resp., l^)'^ 
else 

store the elements in B\^i (resp., -82,*) in a new listnode / 
and insert / into the list of x^ (resp., ^2) so that 
all but the last listnode will have > B^Jmjl elements; 
if x\ (resp., X2) does not satisfy CNI, then Sift it; 
if the total number of root-pointers in i?i j, i?2,i and B[ is < \fm^ then 
move all root-pointers to B^i] Fill-Up B^i] 
delete -82,^ and B[] There is no carry-out; 



CONTINUED 
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else 

create a tree- node x of rank i + 1; 

pool the root-pointers in Bi^i, i?2,i and B'^; 

take ^/m of those roots and make them children of x; Sift(a;); 

create a carry-out bucket -Bj'_,_i; 

place in it a pointer to x; this is to be the only root-pointer of -B^+i; 

move the remaining root-pointers into Bif, Fill-Up Bif, 

delete -82,1 and B'-; 
end; 
update the suffixmin pointers; 



Figure 3.2: Meld 



The number of elements gathered in x is i?A/m/2, unless all of x's children are empty 
leaves. 

Suppose case (A) holds. Create a new listnode /', and store in /' the elements just 
extracted into x. If /' has a size of B^Jmjl^ insert /' at the front of x's list; else if / and /' 
together have at most B^frnjl elements, then merge /' into /; else, append /' at the end 
of the list, and transfer enough elements from /' to / so that / has a size of B^fmjl. 

If case (B) holds, then if x has nonempty children, once again, extract (x), and invoke 
Sift(i/) for each non-leaf child y oi x that now violates PNI. The total number of elements 
gathered in x now is B^/m, unless all of a:'s children are empty leaves. If the number of 
elements gathered is at most B^/mjl^ then create a listnode, store the elements in it, and 
make it the sole member of x's list; otherwise, create two listnodes, insert them in the list 
of a;, store B^fmjl elements in the first, and the rest in the second. 

In both the cases, update the ckey of x so that it will be the largest of all keys now 
present in x's list. 

If a; is a cnode of rank greater than r -|- 1, then while the size of x is less than s^, 
and not all children of x hold empty lists, do the following repeatedly: (i) pick the child 
y oi X with the smallest ckey, (ii) remove the last listnode of x and merge it with the last 
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extract (x) 

begin 

let Nx be the total number of elements in all the children of x 
put together; extract the smallest \m.\l{B^/m/2,Nx} of those 
elements and store them in x; 

end 



Figure 3.3: Extract 



listnode y, if they together have at most By/m elements, (iii) merge the resultant list of 
y to the resultant list of x such that all but the last listnode will have al least B^/m/2 
elements, (iv) set the ckey of x to the ckey of y, and (v) invoke Sift(|/) recursively. If 
merging is not required, then the concatenation merely updates 0(1) pointers. Merging, 
when it is needed, incurs 0{^,/m) I/Os. 

The Sift operation removes all leaves it renders empty. An internal node becomes 
a leaf, when all its children are removed. 



Fill-Up 

The Fill-Up operation is invoked by Deletemin and Meld on a bucket Bi when those 



operations find B^ empty. Bi is filled up using the procedure given in Figure 3.4 



A bucket remembers, for each element e in it, the root from which e was extracted. 
This is useful when the Meld operation sends the elements in the bucket back to their 
respective nodes. 

Even if a Fill-Up moves all elements of a root x without children into the bucket, x 
is retained until all its elements are deleted from the bucket. (A minor point: For i < r, 
if the roots in the bucket all have sent up all their elements into the bucket, are without 
children, and have at most B^frnjl elements together, then all of them except one can 
be deleted at the time of the Fill-Up.) 
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ii i < r then 

for each root x in Bi that does not satisfy PNI 
Sift(a;); 

Let Ni be the total number of elements in all the roots of Bi put together; 

extract the smallest rain{B^/m/2, Ni} of those and store them in Bf, 
else 

for each root x in Bi that does not satisfy CNI 
Sift(x); 

pick the root y with the smallest ckey in Bf, 

copy the contents of one / of y's listnodes (not the last one) into Bf, 

remove / from the list of y. 

Figure 3.4: Fill-Up 

The Memory Requirement 

The following lemma establishes the largest rank that can be present in a heap. 

Lemma 3.1. There are at most — ^t-tt tree-nodes of rank k when N elements have been 
inserted into it. 

Proof: We prove this by induction on k. The basis is provided by the rank-0 nodes. 
A node of rank is created when By/m new elements have been accumulated in the main 
memory buffer. Since the total number of elements inserted in the heap is A^, the total 
number of nodes of rank is at most N / B^Jm. Inductively hypothesise that the lemma 
is true for tree-nodes of rank at most (/c — 1). Since a node of rank k is generated when 
^/m root nodes of rank A; — 1 are combined, the number of nodes of rank k is at most 



N _ N 



Therefore, if there is at least one node of rank k in the heap, then — -p=k+i > 1, and 
so /c < log^/^ ^. Thus, the rank of the EMSH is at most log^/;^ ^. Note that there can 



be at most y/m — 1 trees of the same rank. 

The main memory space required for a bucket is 0{B + \/rn). So, the total space 
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required for all the buckets is 0{{B + y/m) log^/^ ^). We can store all buckets in main 
memory, if we assume that {B + y/m) log /^ ^ = 0{M). This assumption is valid for all 
values of A^ = 0{Bm^'^ ^'^^^^'■^''^) . Assume the modest values for M and B given in [U3] : 
say, a block is of size 1 KB, and the main memory is of size 1 MB, and can contain 5 = 50 
and M = 50000 records respectively. Then, if A^ < 10^*^°, which is practically always, the 
buckets will all fit in the main memory. 

3.3 A Proof of Correctness 

If the heap order property is satisfied at every node in the EMSH before an invocation of 
Sift(x), then it will be satisfied after the invocation returns too. This can be shown as 
follows. 

If X is a pnode, then the invocation causes a series of Extracts, each of which moves 
up into a node a set of smallest elements in its children; none of them can cause a violation 
of the heap order property. 

If X is a cnode of rank r + 1, then a set of smallest elements at x's children move up 
into X and become corrupt. All these elements have key values greater than k', the ckey 
of X prior to the Sift. The new ckey of x is set to the largest key k among the elements 
moving in. Thus, k is smaller than each key in each of x's children after the invocation; 
and k > k' . 

If X is a cnode of rank greater than r + 1, then a set of corrupt elements move into 
X from y, the child of x with the smallest ckey, and the ckey of x is set to the ckey of y. 
Inductively assume that the ckey of y is increased by the recursive Sift on y. Therefore, 
at the end of the Sift on x, the ckey of x is smaller than the ckey of each of x's children. 

In every other operation of the EMSH, all data movements between nodes are 
achieved through Sifts. Thus, they too cannot violate the heap order property. 

When we note that a Fill-Up on a bucket Bi moves into it a set elements with 
smallest keys or the smallest ckey from its roots, and that the suffixmin pointer of Bq 
points to the bucket with the smallest minkey among {B^ \ x > 0}, we have the following 
Lemma. 

Lemma 3.2. // there is no cnode in the EMSH, then the element returned by Deletemin 
will be the one with the smallest key in the EMSH. If there are anodes, and if the returned 
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element is corrupt (respectively, not corrupt), then its ckey (respectively, key) will be the 
smallest of all keys in the pnodes and ckeys of the EMSH. 

For all k > r, and for every nonleaf x of rank k that satisfies CNI, the size of the list 
in X is at least [sfc/2j + 1. For a root x of rank k > r, when the size of its list falls below 
[sfc/2j + 1, Sif t(a;) is not invoked until at least the next invocation of Fill-Up, Meld or 
Deletemin. 

The following lemma gives an upperbound on the size of the list. 

Lemma 3.3. For all k > r, and for every node x of rank k, the size of the list in x is at 
most 3sk- 

proof: We prove this by an induction on k. Note that between one Sift and another 
on a node x, the list of x can lose elements, but never gain. 

A Sift on a node of rank r + 1 causes it to have a list of size at most two; 2 < 
3sr+i = 6; this forms the basis. 

Let a; be a node of rank > r + 1. Hypothesise that the upperbound holds for all 
nodes of smaller ranks. When Sift(a;) is called, repeatedly, a child of x gives x a list L' 
that is then added to the list L of x, until the size of L becomes at least Sk or x becomes 
a leaf. The size of each L' is, by the hypothesis, at most 3sk-i < 2[|sa;_i] = 2sk- 

The size of L is at most sa: — 1 before the last iteration. Therefore, its size afterwards 
can be at most 3sk — 1 < Ssk- □ 



Lemma 3.4. For all values of k > r, 

<Sk<2{^\ - 1 



f~\ \ K T 1. / f~\ \ fC 7' 



Proof: A simple induction proves the lowerbound. Basis: s^+i = 2 > (|) =1. 
Step: For all A; > r + 1, s^ = [|sfc_i] > |sfc_i > (1)''"''"^ 

Similarly, a simple induction shows that, for all values of A; > r + 4, s^ < 2 (|) — 
2. Basis: s^+4 = 8 < 2 (|)^ - 2 = 8.125. Step: Sk = [fsfc-i] < |sfe-i + 1 < 
I [2 (1)^"'"' - 2] +1 = 2 {iy'"-2. Note that s,+i = 2 = 2 (|)-1, Sr+2 = 3 < 2 (|)'-1, 
and Sr+3 = 5<2(|) — 1, Therefore, for all values of A; > r, s^ < 2 (|) — 1. D 

Lemma 3.5. If m > 110, at any time there are at most eN corrupt elements in the 
EMSH, where N is the total number of insertions performed. 
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Proof: All corrupt elements are stored in nodes of rank greater than r. The size of 



the list of a node of rank A; > r is at most 3sk by Lemma |3.3[ Each listnode contains at 
most B^/m corrupt elements. Thus, the total number of corrupt elements at a node of 
rank fc > r is at most ?)SkBy/m. Suppose m > 110. Then ^/Tn > 10.5. 

As r = log^^^, by Lemma 3.4 and Lemma 3.1 , the total number of corrupt elements 
are at most 
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3.4 An Amortised I/O Analysis 

Suppose charges of colours green, red and yellow remain distributed over the data structure 
as follows: (i) each root carries 4 green charges, (iii) each bucket carries 2^/m green 
charges, (ii) each element carries 1/ B red charges, (iv) each nonleaf node carries one 
yellow charge, and (v) each leaf carries ^/^m + 1 yellow charges. 

In addition to these, each element also carries a number of blue charges. The amount 
of blue charges that an element carries can vary with its position in the data structure. 

The amortised cost of each operation is its actual cost plus the total increase in all 
types charges caused by it. Now we analyse each operation for its amortised cost. 

Insert: Inserts actually cost Q{^J^m) I/Os when the insert buffer in the main memory 
runs full, which happens at intervals of VL{By/m) inserts. Note that some Deletemins 
return elements in the insert buffer. If an Insert causes the buffer to become full, then it 
creates a new node x, a tree T with x as its only node, and a heap H' with T as its only 
tree. The By/m elements in the buffer are copied into x. Moreover, a bucket is created 
for H' . New charges are created and placed on all new entities. Thus, this Insert creates 
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4 + 1^/rn green charges, ym red charges, and ^Jm + 1 yellow charges. Suppose it also 
places Q{r / B) blue charges on each element of x. That is a total of Q{r^/rrl) blue charges 
on X. That is, the total increase in the charges of the system is Q{ry/m). It follows that 
the amortised cost of a single Insert is 0{r/B). 

Meld: The buckets are processed for positions to max+1 in that order, where max 
is the largest rank in the two heaps melded. The process is analogous to the addition of 
two ^m-radix numbers. At the i-th position, at most three buckets are to be handled: 
-Si,i, -02,1 and the "carry-in" B[. Assume inductively that each bucket holds 2^Jm green 
charges. 

If only one of the three buckets is present at position i, then there is no I/O to 
perform, no charge is released, and, therefore, the amortised cost at position i is zero. 

If at least two of the three are present, then the actual cost of the operations at 
position i is 0{^/m). As only one bucket will be left at position i, at least one bucket 
is deleted, and so at least 2^/m green charges are freed. Suppose, ^/m of this pays for 
the work done. If there is no "carry-out" B[^i to be formed, then the amortised cost at 
position i is negative. 

If -B^+i is to be formed, then place ^/m of the remaining green charges on it. When 
B'^j^^ is formed, ^Jm roots hook up to a new node; these roots cease to be roots, and so 
together give up 4:^/m green charges; four of that will be placed on the new root; 4^/m — 4 
remain; 4^/m — 4 > ^/rn, as m > 2. So we have an extra of ^/rn green charges to put on 
the carry-out which, with that addition, holds 2^/rn green charges. No charge of other 
colours is freed. 

The amortised cost is non-positive at each position i. So the total amortised cost of 
Meld is also non-positive. 

Deletemin: A typical Deletemin is serviced from the main memory, and does not 
cause an I/O. Occasionally, however, an invocation to Fill-Up becomes necessary. The 
actual I/O cost of such an invocation is 0{^/m). A Fill-Up is triggered in a bucket when 
Q{B^/m) elements are deleted from it. At most a block of the bucket's elements are kept 
in the main memory. Thus, a block will have to be fetched into the main memory once 
in every B Deletemins. The red charges of deleted items can pay for the cost of the all 
these I/Os. The amortised cost of a Deletemin is, therefore, at most zero. 

Findmin: As no I/O is performed, and no charge is released, the amortised cost is 
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zero. 

Fill-Up: This operation is invoked only from Meld or Deletemin. The costs have 
been accounted for in those. 

Sift: Consider a Sift on a node x of rank < r + 1. This performs one or two 
Extracts. The actual cost of the Extracts is 0{^/m). If the number of extracted elements 
is Q{B^/rri), then each extracted element can contribute 1/ B blue charges to pay off the 
actual cost. If the number of extracted elements is o{B^/m), then x has become a leaf 
after the Sift. Therefore, all of x's children were leaves before the Sift. One of them 
can pay for the Sift with its ^/m yellow charges; at least one remained at the time of the 
Sift. Node x that has just become a leaf, has lost the ^/m children it once had. If one 
yellow charge from each child has been preserved in x, then x now holds ^/m + 1 yellow 
charges, enough for a leaf. 

Consider a Sift on a node x of rank i > r + 1. A number of iterations are performed, 
each of which costs 0{^/m) I/Os. In each iteration, a number of elements move from a 
node of rank i — 1 (namely, the child y oi x with the smallest ckey) to a node of rank i 
(namely, x). If the number of elements moved is Q{B^/m), then the cost of the iteration 
can be charged to the elements moved. Suppose each element moved contributes j-^ 
blue charges. Since the list of y has at least [si_i/2 + Ij listnodes, in which all but the 
last have at least B^fmjl elements, the total number of blue charges contributed is at 
least ^-^-g L^^J 2 ~ 0(v^)- Thus, the cost of the iteration is paid off. 

If the number of elements moved is o(B^fm)^ then y was a leaf prior to the Sift, 
and so can pay for the Sift with its ^Jm yellow charges. If x becomes a leaf at the end of 
the Sift, it will have ^Jm^ 1 yellow charges on it, as one yellow charge from each deleted 
child is preserved in x. 

An element sheds XjB blue charges for each level it climbs up, for the first r + 1 
levels. After that when it moves up from level i — 1 to i, it sheds j— '-g blue charges. 
Therefore, with 



B ^ Si-iB B ^B\3j \B 

i>r+l i>r ^ ' 

blue charges initially placed on the element, it can pay for its travel upwards. 
Thus, we have the following lemma. 

Lemma 3.6. In EMSH, the amortised complexity of an Insert is 0{j^ log^ ^)- Findmin, 
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Deletemin and Meld all have non-positive amortised complexity. 

3.5 Hard heap: A Meldable Priority Queue 

When an EMSH has error-rate e = 1/{N + 1), no element in it can be corrupt. In this 
case, EMSH becomes an exact priority queue, which we call hard heap. In it every node 
is a pnode, and every tree is a ptree. Deletemins always report the exact minimum in 
the hard heap. The height of each tree is 0(log„ ^), as before. But, since all nodes are 
pnodes, the amortised cost of an insertion is 0(^ log„ ^) I/Os. The amortised costs of 
all other operations remain unchanged. 

The absence of corrupt nodes will also permit us to implement a Delete operation: 
To delete the element with key value k, insert a "Delete" record with key value k. Even- 
tually, when k is the smallest key value in the hard heap, a Deletemin will cause the 
element with key k and the "Delete" record to come up together. Then the two can 
annihilate each other. The amortised cost of a Delete is 0{j^ logm %) ^/Os, the same as 
that of an Insert. 

None of the known external memory priority queues (EMPQs) [3 [SH |57], support 
a meld operation. However, in all of them, two queues could be melded by inserting 
elements of the smaller queue into the larger queue one by one. This is expensive if the 
two queues have approximately the same size. The cost of this is not factored into the 
amortised complexities of those EMPQs. 

The actual cost of a meld of two hard heap's with A^ elements each is 0{y/m\og^ ^) 
I/Os; the amortised cost of the meld is subzero. But this is the case only if the buckets 



of both the heaps are in the main memory. Going by our earlier analysis in Section 3.2.1 
if A^ = 0{Bm^^^'^''^^'^^^) then k heaps of size N each can keep their buckets in the main 
memory. 

The buckets of the heaps to be melded could be kept in the secondary memory, and 
brought into the main memory, and written back either side of the meld. The cost of 
this can be accounted by an appropriate scaling of the amortised complexities. However, 
operations other than meld can be performed only if the buckets are in the main memory. 

In hard heap, unlike in the other EMPQs, elements move only in the upward direc- 
tion. That makes hard heap easier to implement. Hard heap and the external memory 
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heap of [31] do not require any extra space other than is necessary for the elements. The 



other EMPQs [Zl EI] use extra space (See Table 3.1). 

The buffer tree [^ is a B+ tree, and therefore uses a balancing procedure. However, 
because of delayed deletions, its height may depend on the number of pending deletions, 
as well as the number of elements left in it. The external memory heap of [31] is a 
balanced heap, and therefore, incurs a balancing cost. But, in it the number of I/Os 
performed by a sequence of S operations is 0(^ + j^J2i=i^^Smi^)^ where Ni is the 
number of elements remaining in the heap before the i-th operation; this is helpful when 
the inserts and deletemins are intermixed so that the number of elements remaining in 
the data structure at any time is small. 

In comparison, hard heap is not a balanced tree data structure. It does not use 
a costly balancing procedure like the heaps of [3ll [57]. However, for a sequence of N 
operations, the amortised cost of each operation is 0{j^ log^ %) I/Os. 

We can make the amortised cost depend on A^j, the number of elements remaining 
in the hard heap before the i-th operation, at the cost of adding a balancing procedure. 
In a sequence of operations, whenever Nj, the number of inserts performed, and Nd, 
the number of deletemins performed, satisfy Nj — N^ < Nij ^fm^ and the height of the 
hard heap is log /^ -j^, delete the remaining Nj — N^ elements from the hard heap, insert 
them back in, and set the counts Nj and No to Nj — N^ and zero respectively; we can 
think of this as the end of an epoch and the beginning of the next in the life of the hard 
heap. The sequence of operations, thus, is a concatenation of several epochs. Perform an 
amortised analysis of each epoch independently. The cost of reinsertions can be charged 
to the elements actually deleted in the previous epoch, thereby multiplying the amortised 
cost by a factor of 0(1 + -^). It is easy to see that now the number of I/Os performed 
by a sequence of S operations is 0(^ + -^ X]i=i logm '^)- 

3.5.1 Heap Sort 

We now discuss an implementation of Heap Sort using hard heap, and count the number 
of comparisons performed. To sort, insert the N input elements into an initially empty 
hard heap, and then perform A^ deletemins. 

When a node of rank is created, 0{B^/m\og2{B^/m)) comparisons are performed; 
that is 0{log2{B^/m)) comparisons per element involved. When an elements moves from 
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a node to its parent, it participates in a i/m-way merge; a A/^-way merge that outputs 
k elements requires to perform only 0(A;log2 \/rn) comparisons; that is 0(log2 i/m) com- 
parisons per element involved. Since the number of levels in the hard heap is at most 
log /:f^N/B^/rn, the total number of comparisons performed by one element is log2 A^. 
Each deletemin operation can cause at most log /^(N/y/mB) comparisons among the 
suffixmin pointers. Thus, the total number of comparisons is 0(A^log2 A^). 

3.6 Applications of EMSH 

The external memory soft heap data structure is useful for finding exact and approximate 
medians, and for approximate sorting [19]. Each of these computations take 0{N/B) 
I/Os: 

1. To compute the median in a set of A^ numbers, insert the numbers in an EMSH 
with error rate e. Next, perform eN Deletemins. The largest number e deleted 
has a rank between eA^ and 2eN. Partition the set using e as the pivot in 0{N/B) 
I/Os. We can now recurse with a partition of size at most max{e, (1 — 2e)}N. The 
median can be found in 0{N/B) I/Os. This is an alternative to the algorithm in 
[79] which also requires 0{N/B) I/Os. 

2. To approximately sort A^ items, insert them into an EMSH with error rate e, and 
perform A^ Deletemins consecutively. Each element can form an inversion with at 
most eA^ of the items remaining in the EMSH at the time of its deletion. The output 
sequence, therefore, has at most eN"^ inversions. We can also use EMSH to near 
sort A^ numbers in 0{N/B) I/Os such that the rank of each number in the output 
sequence differs from its true rank by at most eA^; the in-core algorithm given in 
[T9] suffices. 
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Chapter 4 



The Minimum Cut Problem 



4.1 Introduction 



The mininiuni cut problem on an undirected unweighted graph is to partition the vertices 
into two sets while minimizing the number of edges from one side of the partition to the 
other. This is an important combinatorial optimisation problem. Efficient in-core and 
parallel algorithms for the problem are known. For a recent survey see [HI [521 |53l [69] . This 
problem has not been explored much from the perspective of massive data sets. However, 
it is shown in [31 [77] that the minimum cut can be computed in a polylogarithmic number 
of passes using only a polylogarithmic sized main memory on the streaming and sort 
model. 

In this chapter we design an external memory algorithm for the problem on an undi- 
rected unweighted graph. We further use this algorithm for computing a data structure 
which represents all cuts of size at most a times the size of the minimum cut, where 
a < 3/2. The data structure answers queries of the following form: A cut X (defined 
by a vertex partition) is given; find whether X is of size at most a times the size of the 
minimum cut. We also propose a randomised algorithm that is based on our deterministic 
algorithm, and improves the I/O complexity. An approximate minimum cut algorithm 
which performs fewer 1/Os than our exact algorithm is also presented. 
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4.1.1 Definitions 

For an undirected unweighted graph G = (V, -E), a cut X = {S,V — S) is defined as a 
partition of the vertices of the graph into two nonempty sets 5* and V — S. An edge with 
one endpoint in S and the other endpoint in {V — S) is called a crossing edge of X. The 
value c of the cut X is the total number of crossing edges of X. 

The minimum cut (mincut) problem is to find a cut of minimum value. On un- 
weighted graphs, the minimum cut problem is sometimes referred to as the edge-connectivity 
problem. We assume that the input graph is connected, since otherwise the problem is 
trivial and can be computed by any connected components algorithm. A cut in G is 
a-minimum, for a > 0, if its value is at most a times the minimum cut value of G. 

A tree packing is a set of spanning trees, each with a weight assigned to it, such that 
the total weight of the trees containing a given edge is at most one. The value of a tree 
packing is the total weight of the trees in it. A maximum tree packing is a tree packing 
of largest value. (When there is no ambiguity, will use "maximum tree packing" to refer 
also to the value of a maximum tree packing, and a "mincut" to the value of a mincut.) 
A graph G is called a (5-fat graph for 5 > 0, if the maximum tree packing of G is at least 
^ [52]. 

After [52], we say that a cut X fc-respects a tree T (equivalently, T fc-constrains X), 
if E[X] n E\T] < k, where E{X) is the set of crossing edges of X, and E{T) is the set of 
edges of T. 

4.1.2 Previous Results 

Several approaches have been tried in designing in-core algorithms for the mincut problem. 
See the results in [33l[35lll0lll3llMll52l[6Hl[TQl[ni[HQ]. Significant progress has been 
made in designing parallel algorithms as well [38] l5T| [521 153]. The mincut problem on 
weighted directed graphs is shown to be P-complete for LOGSPACE reductions [3HI EI]- 
For weighted undirected graphs, the problem is shown to be in NC [53]. We do not know 
any previous result for this problem on the external memory model. 

However, the current best deterministic in-core algorithm on an unweighted graph 
computes the minimum cut in 0{E + c^V\og{V/c)) time, and was given by Gabow [53] . 
Gabow's algorithm uses the matroid characterisation of the minimum cut problem. Ac- 
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cording to this characterisation, the minimum cut in a graph G is equal to the maximum 
number of disjoint spanning trees in G. The algorithm computes the minimum cut on 
the given undirected graph in two phases. In first phase, it partitions the edges E into 
spanning forests Fi,i = 1, ... ,N in 0{E) time using the algorithm given in [68]. This algo- 
rithm requires 0(1) I/O for each edge in the external memory model. In the second phase, 
the algorithm computes maximum number of disjoint spanning trees in 0{c^V\og{N/c)) 
time. To compute maximum number of disjoint spanning trees, augmenting paths like 
in fiow based algorithms are computed. The procedures used in computing augmenting 
paths access the edges randomly and require 0(1) I/Os for each edge in the external 
memory model. Thus, this algorithm, when executed on the external memory model, 
performs 0{E + c^V"log(V^/c)) I/Os. 



4.1.3 Our Results 

We present a minimum cut algorithm that runs in 0(c(MSF(y, £■) log£^ + ^Sort(V^))) 
I/Os, and performs better on dense graphs than the algorithm of [35], which requires 
0{E + c^V log(y/c)) I/Os, where MSF(V, E) is the number of I/Os required in computing 
a minimum spanning tree. For a 6-iat graph, our algorithm computes a minimum cut in 
0(c(MSF(V, E) logE + Sort(£'))) I/Os. Furthermore, we use our algorithm to construct 
a data structure that represents all a-minimum cuts, for a < 3/2. The construction of 
the data structure requires an additional O (Sort (A;)) I/Os, where k is the total number of 
a-minimum cuts. Our data structure answers an a-minimum cut query in 0{V/B) I/Os. 
The query is to verify whether a given cut (defined by a vertex partition), is a-minimum 
or not. 

Next, we show that the minimum cut problem can be computed with high probability 
in 0(c-MSF(y, E) \ogE+SoTt{E) log^ V+^SoTt{V) log\/) I/Os. We also present a (2+e)- 
minimum cut algorithm that requires 0{{E /V)MSF{V, E)) I/Os and performs better on 
sparse graphs than our exact minimum cut algorithm. 

All our results are summarised in Table 14.11 
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Problems on EM model 


Lower/Upper Bounds 


mincut of an undirected 
unweighted graph 


fi(fSort(V)) 
0{c{MSF{V,E)\ogE + ^SoTt{V))) 


mincut of a 6-iat graph 


0{c{MSF{V,E)\ogE + SoTt{E))) 


Monte Carlo mincut algorithm 
with probability 1 — 1/V 


0{c-MSF{V,E)logE+ 
Sort(E) log2 V + |Sort(\/) log V) 


(2 + e)-approx. mincut 


0{{E/V)MSF{V,E)) 


Data Structure for 
all a-mincuts 


0{c{MSF{V,E)logE + ^SoTt{V)) + SoTt{k)) 
answers a query in 0{V/B) I/Os 



Table 4.1: Our Results 



4.1.4 Organisation of This Chapter 



The rest of the chapter is organised as follows. In Section 4.2, we define some notations 



used in this chapter. In Section 4.3, we give a lower bound result for the minimum cut 



problem. In Section |4.4[ we present an external memory algorithm for the minimum 
cut problem. Section 4.5| describes the construction of a data structure that stores all 



a-minimum cuts, for a < 3/2. In Section 4.6 we improve the I/O complexity of our 



minimum cut algorithm by using randomisation. In Section 4.7, we discuss a special class 



of graphs for which a minimum cut can be computed very efficiently. In Section |4.8[ we 
present a (2 + e)-minimum cut algorithm. 



4.2 Some Notations 



For a cut X of graph G, E{X) is the set of crossing edges of X. For a spanning tree T of 
G, E{T) is the set of edges of T. 

Let V J, denote the set of vertices that are descendants of v in the rooted tree, and 
V t" denote the set of vertices that are ancestors of v in the rooted tree. Note that v (z v \. 
and f G f t- Let C{A, B) be the total number of edges with one endpoint in vertex set 
A and the other in vertex set B. An edge with both endpoints in both sets is counted 
twice. Thus, C{u,v) is 1, if {u^v) is an edge, otherwise. For a vertex set S", let C{S) 
denote C(5,\/- 5). 
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4.3 A Lower Bound for the Minimum Cut Problem 

We use P-way Indexed I/O-tree to prove the lower bound. The P-way Indexed I/O-tree is 
defined in [65] and is shown that it can be transformed to a binary decision for the same 
problem. We can use the bound on the number of comparisions in the decision tree to 
establish a bound on the number of I/Os in the P-way Indexed I/O-tree. The following 
lemma, given in |65j can be used to prove the lower bound on I/Os. 

Lemma 4.1. fU^ Let X be the problem solved by an I/O tree I /Ox, with N the number 
of records in the input. There exists a decision tree Tc solving X , such that: 

Pathr^ <N\ogB + D.I /Or ■ 0{B log — ^ + log P) 

We define two decision problems Pi and P'^ as follows: 

Definition 4.2. Pi: Given as input a set S of N elements, each with an integer key 
drawn from the range [1,-P], say "yes" when S contains either every odd element or at 
least one even element in the range [1,-P], and say "no" otherwise (that is, when S does 
not contain at least one odd element and any even element in the range [1,P].) 

Definition 4.3. P^ The problem is a restriction of Pi. Suppose the input S is divided 
into P subsets each of size N/P and containing distinct elements from the range [P + 
1,2P], where P < N < P([P/2] — 1). P'^^ is to decide whether S contains either every 
odd element or at least one even element in the range [P + 1, 2P]. 

First, we prove the following claim for Pi, 

Claim 4.4. The depth of any decision tree for Pi is Q{N\ogP). 

Proof. {\P/2] — 1)^ and [|^]([P/2] — 1)^ are, respectively, lower and upper bounds on 
the number of different "no" instances. If we prove that in any linear decision tree for Pi, 
there is a one-one correspondence between "no" instances and leaves that decide "no", 
then the depth of any decision tree for Pi is r2(A^logP). 

Our proof is similar to the ones in [65J . We consider tertiary decision trees in which 
each decision node has three outcomes: <, =, >. Each node, and in particular each leaf, 
corresponds to a partial order on S* U {1, . . . , P}. Consider a "no" leaf / and the partial 
order P0{1) corresponding to /. All inputs visiting / must satisfy P0{1). Let Ci, . . . Cfc 
be the equivalence classes of P0{1). Let Ui and di be the maximum and minimum values 
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respectively of the elements of equivalence class Ci over all "no" inputs that visit /. Exactly 
one input instance visits / if and only if Ui = di for all i. If Ui ^ di for some Ci then, 
pick a "no" input / that visits I and fabricate a "yes" input /' as follows: assign an even 
integer e, di < e < Ui, to every element in Ci, and consistent with this choice and P0{1) 
change the other elements of I if necessary. Note that this fabrication is always possible. 
Since /' is consistent with P0{1), it visits /; a contradiction. Hence our claim. D 

Now we consider the restriction P'j^ of Pi. 

Claim 4.5. The depth of any decision tree for P'^ is VL{N\ogP). 

Proof. A lower bound on the number of "no" instances of P'^ is {P' ■ {P' — 1) ■ {P' — 2) ■ 
..." (P' - N/P)Y = fi(P)^, where P' = \P/2] - 1. An argument similar to the above 
shows that in any decision tree for P'^, the "no" instances and leaves that decide "no" 
correspond one to one. Therefore, the depth of any decision tree for P'^^ is Q{N log P). D 

Theorem 4.6. The depth of any I/O-tree for computing the min-cut of a V vertex, E 
edge graph is Q{^Sort{V)) assuming E >V and log\^ < -Blog ^. 

Proof. We construct an undirected graph G = {V, E) from an input instance / of P'^^ as 
follows. 

1. Let the integers in [1,2P] constitute the vertices. 

2. Make a pass through I to decide if it contains an even element. If it does, then for 
each i E [P + 1,2P — 1], add an edge {i,i + 1} to G. Otherwise, remove all even 
integers (vertices) > P from G. 

3. Make a second pass through /. If the jth subset of / contains P + i, then add an 
edge {j, P + i} to G. 

4. For i e[l,P -1], add an edge {i, z + 1} to G. 



Here |^| = Q{P) and |-E| = O(A^). One example is shown in figure 4.1 The construction 
of the graph requires 0{N/B) I/Os. It needs looking at the least significant bits (LSBs) 
of the keys of the elements; if the LSBs are assumed to be given separately from the rest 
of the keys, this will not violate the decision tree requirements. The value of the minimum 
cut of G is at least 1 iff P'^ answers "yes" on /. 

The bound then follows from the lemma 14.11 and claim 14.51 D 
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P = 5, 

Yes Instance L 



yes 



{/i = 7,J2 = 7,/3 = 8,J4 = 7,/5 = 6} 



No Instance /no = {h = 7,h = 7, I3 = 7, J4 = 7, Is = 7} 





Graph from Yes Instance 



Graph from No Instance 



Figure 4.1: Example of 'Yes' and 'No' Instance 

4.4 The Minimum Cut Algorithm 

We present an I/O efficient deterministic algorithm for finding mincuts on undirected 
unweighted graphs. Our I/O efficient algorithm is based on the semi-duality between 
minimum cut and tree packing. The duality was used by Gabow [3S] in designing a 
deterministic minimum cut in-core algorithm for both directed and undirected unweighted 
graphs. It was also used by Karger [52] in designing a faster but randomized in-core 
algorithm for undirected weighted graphs. Our algorithm uses Karger's ideas [52] . 

Nash- Williams theorem [72] states that any undirected graph with minimum cut c 
has at least c/2 edge disjoint spanning trees. It follows that in such a packing, for any 
minimum cut, there is at least one spanning tree that 2-constrains the minimum cut. 
Once we compute such a packing, the problem reduces to finding a minimum cut that is 
2-constrained by some tree in the packing. The assumption on edge disjointness is further 
relaxed by Karger [52] in the following lemma. 



Lemma 4.7. JSM/ For any graph G, for any tree packing P of G of value fie, and any cut 
X of G of value ac (a > (3), at least (1/2) (3 — a/P) fraction (by weight) of trees of P 
2-constrains X . 



If an approximate algorithm guarantees a /3c packing P, for /3 > 1/3, at least |(3— 4) 
fraction (by weight) of the trees in P 2-constrains any given minimum cut X. In particular. 
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Initially no spanning tree has any weight, and all edges have load 0. 

SetW = 

While no edge has load 1 perform all of the following steps 

Pick a load minimal spanning tree T. 

w{T) =w{T) + ey3\ogE. 

W = W + ey3\ogE. 

For all edges (m, v) selected by T, 
l{u, v) = l{u, v) + w{T) 
Return W. 



Figure 4.2: Greedy Tree Packing Algorithm for Computing a (1 — e) -approximate tree 
packing 

there is at least one tree in P that 2-constrains any given minimum cut X. 

4.4.1 The Algorithm 

From the above discussion, we can conclude that the minimum cut problem can be divided 
into two subproblems, (i) compute an approximate maximal tree packing P of value /3c, 
for /3 > 1/3, and (ii) compute a minimum cut of the graph G that is 2-constrained by 
some tree in P. 

Subproblem 1 



We use the greedy tree packing algorithm given in [75] [81] [88]. It is described in Figure 4.2 
A tree packing in G is an assignment of weights to the spanning trees of G so that each 
edge gets a load of 

1{U,V) = T.T:(u,v)&T^{T) < 1 

The value of tree packing is W = Ylr'^i'^)- '^^^ algorithm is given in Figure 
As mentioned in [8l], the algorithm obtains the following result. 
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4.2 



Theorem 4.8. 175\ \8o^ The greedy tree packing algorithm, when run on a graph G, 
computes a {1 — e)- approximate tree packing of value W ; that is, (1 — e)r <W<t, where 
T is the maximum value of any tree packing of G, and < e < 1. 

Since each iteration increases the packing value by e^/(3 log E), and the packing value 
can be at most c, the algorithm terminates in 0{c log E/e^) iterations. The I/O complexity 
of each iteration is dominated by the minimal spanning tree computation. Thus, number 
of I/Os required is 0(c-MSF(V^, E) logE). Since the value of the maximum tree packing is 



at least c/2, the size of the computed tree packing is at least (1 — e)c/2. From Lemma 4.7 
it follows that, for e < 1/3, and any minimum cut X, the computed tree packing contains 
at least one tree that 2-constrains X. 

Subproblem 2 

Let T = (y, E') be a spanning tree of graph G = (V, E). For every K (1 E' there is unique 
cut X so that K = E(T) fl E{X). X can be constructed as follows: Let A = 0. For some 
s & V, for each vertex v in V, add v to set A, iff the path in T from s to f has an even 
number of edges from K; clearly X = {A, V — A) is a. cut of G. 

A spanning tree in the packing produced by Subproblem 1 2-constrains every mincut 
of G. We compute the following: (1) for each tree T of the packing, and for each tree 
edge (u, v) in T, a cut X such that (m, v) is the only edge of T crossing X, (2) for each 
tree T of the packing, and for each pair of tree edges {ui,Vi) and {u2,V2), a cut X such 
that {ui,vi) and {u2,V2) are the only edges of T crossing X. A smallest of all the cuts 
found is a minimum cut of G. 

First we describe the computation in (1). Root tree T at some vertex r in 0(Sort(V^)) 



I/Os |20]. (See Section 4.2 for notations.) G{v l) is the set of edges whose one endpoint is 
a descendent of v, and the other endpoint is a nondescendent of v. If {v,p{v)) is the only 
tree edge crossing a cut X, then G{v l) is the value of cut X, where p{v) is the parent of 
V in T. As given in [52], The value of G{v l) is 

C{v i) = d^{v) - 2p^{v) 

where d^{v) is the total number of nontree edges incident on vertices in v J,, and pi{v) 
is the total number of nontree edges whose both endpoints are in v I. G{y ]^) is to be 
computed for all vertices v in tree T, except for the root r. 
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d^{v) can be computed by using expression tree evaluation, if the degree of each 
vertex v is stored with v. p'^{v) can be computed using least common ancestor queries 
and expression tree evaluation. Once d'^{v) and p^{v) are known for every vertex v E T, 
C{v D can be computed for every vertex v using expression tree evaluation. If we use the 
I/O efficient least common ancestor and expression tree evaluation algorithms of [201189]. 
the total number of I/Os needed for the computation in (1) is 0(Sort(V)). 

For the computation in (2), consider two tree edges {u,p{u)) and {v,p{v)), the edges 
from two vertices u and v to their respective parents. Let X be the cut characterised by 
these two edges (being the only tree edges crossing X). 

We say vertices u and v are incomparable, ii u ^ v ]. and v ^ u I; that is, if they are 
not on the same root-leaf path, li u E v ], ot v E u I, then u and v are called comparable 
and both are in the same root-leaf path. 

In the following, when we say the cut of u and v, we mean the cut defined by edges 
{p{u),u) and {p{v),v). 



As given in [52] and shown in Figure 4.4 and Figure 4.5, if u and v are incomparable 
then the value of cut X is 

C{u iUvi) = C{u i) + C{v i) - 2C{u i, V i) 

If vertices u and v are comparable then the value of X is 

C{ui-vi) = C{u i) - C{v i) + 2{C{u 4, t; i) - 2p^{v)) 

For each tree in the packing, and for each pair of vertices in the tree we need to 
compute the cuts using the above formulae. We preprocess each tree T as follows. Par- 
tition the vertices of T into clusters Vi,V2, . . . ,Vn (where A^ = Q(y/B)), each of size 
0(5), except for the last one, which can of a smaller size. Our intention is to process 
the clusters one at a time by reading each Vi into the main memory to compute the cut 
values for every pair with at least one of the vertices in Vi. We assume that T is rooted 
at some vertex r. 

Partitioning of vertices: For each vertex v E V, a variable Var(f ) is initialised to 1. 
The following steps are executed for grouping the vertices into clusters. 

Compute the depth of each vertex from the root r. Sort the vertices m G V^ in 
the decreasing order of the composite key (depth(u),p(u)). Depth of r is 0. Access the 
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vertices in the order computed above. Let v be the current vertex. 

• Compute Y = Var(t>) + Var(f i) + . . . + Var(f fc), where vi,V2, ■ ■ ■ ,Vk are the children 
oi V. liY<B then set Var(f ) = Y. 

• Send the value Var(i;) to the parent of v, if v is not the root r. 

• li Y > B, divide the children of v into clusters Q = Qi,Q2, ■ ■ ■ ,Qi such that for 
each cluster Qi, X^msq, Var('u) = Q{B). If f = r, it joins one of the clusters Qi. 

After executing the above steps for all vertices, consider the vertices u, one by one, 
in the reverse order, that is, in increasing order of the composite key {depth{u) , p{u)) . Let 

V be the current vertex. If v is the root, then it labels itself with the label of the cluster 
to which it belongs. Otherwise, v labels itself with the label received from its parent. If 

V has not created any clusters, then it sends its label to all its children. Otherwise, let 
the clusters created by v be Qi, Q2, ■ ■ ■ , Qu "^ labels each cluster uniquely and sends to 
each child Vi the label of the cluster that contains Vi. At the end, every vertex has got 
the label of the cluster that contains it. 

In one sort, all vertices belonging to the same cluster Vi can be brought together. 
Since T is a rooted tree, each vertex u knows its parent p{u). We store p{u) with u in Vi. 
Thus, Vi along with the parent pointers, forms a subforest r[Vj] of T, and we obtain the 
following lemma. 

Lemma 4.9. The vertices of a tree T can he partitioned into clusters Vl, . . . Vat (where 
N = Q(y/B)), of size Q{B) each, in 0{Sort(y)) I/Os, with the clusters satisfying the 
following property: for any two roots u and v in T[Vi\, p{u) = p{v). 

Proof. The partitioning procedure uses the time forward processing method for sending 
values from one vertex to another and can be computed in 0(Sort(y)) I/Os |20l [89] . 
The depth of the nodes can be found by computing an Euler Tour of T and applying list 
ranking on it [89l|20] in 0(Sort(\/)) I/Os. Thus, a total of 0(Sort(F)) I/Os are required 
for the partitioning procedure. 

The property of the clusters mentioned in the lemma follows from the way the clusters 
are formed. Each cluster Vi is authored by one vertex x, and therefore each root in T\Vi\ 
is a child of x. D 
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Connect every pair Vi,Vj of clusters by an edge, if there exists an edge e E E' such 
that one of its endpoint is in Vi and the other endpoint is in Vj. The resulting graph G' 
must be a tree, denoted as cluster tree T'. Note that T' can be computed in 0(Sort(l^)) 
I/Os. Do a level order traversal of the cluster tree: sort the clusters by depth, and then 
by key (parent of a cluster) such that (i) deeper clusters come first, and (ii) the children 
of each cluster are contiguous. We label the clusters in this sorted order: Vi,V2, . . . , V^. 
Within the clusters the vertices are also numbered the same way. 

Form an array 5*1 that lists Vi, . . . ,Vn in that order; after Vi and before V^+i are 
listed nonempty -Ejj's, in the increasing order of j; Eij C E — E', is the set of non-T edges 
of G with one endpoint in Vi and the other in Vj. With Vi are stored the tree edges of 
T[Vi]. Another array 5*2 stores the clusters Vi in the increasing order of i. The depth of 
each cluster in the cluster tree can be computed in 0(Sort(V^)) I/Os [20l [89], and arrays 
5"! and 5*2 can be obtained in 0(Sort(V^ + E)) I/Os. 

Computing cut values for all pair of vertices: Now, we describe how to compute 
cut values for all pair of vertices. Recall that the value of the cut for two incomparable 
vertices u and v is 

G{uiUvi) = G{u i) + G{v i) - 2G[u 4, v 4) 

and for two comparable vertices u and v is 

G[ui-vi) = G[u i) - G[v ;) + 2(C(m i,v i) - Ip^v)) 

Except for G{u \^,v J,), all the other values of both expressions have already been 
computed. C{u |, v J,) can be computed using the following expression. 

G{u i, f i) = Y.U C'("fc i> ^ i) + Eo C{u, vi I) + G{u, v) 



where, u and v vary over the children of u and v respectively. In Figure 4.3, we give the 
procedure for computing G{u |, v |) and cut values for all pairs u and v. In the procedure 
p{u) is the parent of u in T, P{Vi) is the parent of Vi in the cluster tree. 

For each i,j G A^, Vi, Vj and Eij are brought in main memory. Note that the size of 
Eij can be at most 0{B^). We assume that size of main memory is Q{B^). G{u \) and 
p^{u) are stored with vertex u. 

We mark all ancestors of each vertex u & Vi. Note that the ancestor vertices of 
each vertex u & Vi which reside in other clusters Vj for j ^ i, are the same, and Vj is 
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Let binary Li be 1 iff "l^ is a leaf of tlie cluster tree" ; Li is its negation 
Let binary /„ be 1 iff "m is a leaf in its cluster" ; /„ is its negation 
For 1 < i < A^, For 1 < j < iV 

For each (m, v) E Vi ^ Vj considered in lexicographic ordering 
if l^ and -^Lj 

Deletemin(Qi) to get {j,u,v,Y); add Y to F„; 
if lu and -iL, 

Deletemin((52) to get {i,j,u,v,X); add X to X„; 
For each {u, v) E Vi x Vj considered in lexicographic ordering 
^ = E. C{u, I, V i) 

C{u ;, t; i) = Afu + XuLilu + Bl^ + Y^Ljl, + C(m, v) 
if -u and f are incomparable vertices 

C(m i U t; i) = C(m i) + C(t; i) - 2C{u i, t; ;) 
if u and f are comparable vertices 

C{ui-vi)= C{u i) - C{v i) + 2{C{u i,vi)- 2p^{v)) 
Let Tji, . . . rjjfc be the roots in T\Vi\ 
Let Tji, . . . Tj/ be the roots in T\Vj\ 
For each vertex u &Vi 

r« = C(M,r,i ;) + ... + C(M,r,a) 
store (P(V;),M,p(r,i),F«) in Qi 
For each vertex v (zVj 

X- = C{r,^i,vi) + ... + C{riki,vi) 
Store {PiVi),j,pira),v,X'") in Q2 



Figure 4.3: Procedure to compute cut values for all pair of vertices 
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Figure 4.4: C{u | U f |): set of edges from region 2 to 1 and 3 to 1 




Figure 4.5: C{u I — v l): set of edges from region 2 to 1 and 2 to 3 



68 



an ancestor of Vi in cluster tree T'. We can mark all the ancestor vertices in additional 
0{V/B) I/Os. 

Two priority queues Qi and Q2 are maintained during the execution of the algorithm. 
Qi holds value Fj™ = C{u, t>i J,) + . . . + C{u, vi |) with key value (j, u, v) for each vertex 
u E Vi and v G Vj, while cluster Vj is yet to be accessed for Vi, and after Vk (with 
k < j, and containing exactly Vi,...vi among the children of v), has been processed 
for Vi, and C{u,vi I), . . .C{u,vi |) have been computed. Note that it is not necessary 
that all children of v are in one cluster Vj. Similarly Q2 holds value X"-" = C{ui i,v l 
)+. . .+C{ui I, V I) with key value {i, j, u, v) for each vertex u &Vi and v E Vj, while cluster 
Vj is yet to be accessed for Vi, and after Vj has been processed for Vk (with k < j, and 
containing exactly ui, . . .ui among the children of u), and C{ui l,v l), . . . ,C{ui l,v |) 
have been computed. Note that it is not necessary that all children of u are in one node 
Vk. 

The correctness of the algorithm is easy to prove. Since, for each cluster we perform 
0{V/B) I/Os and 0{V) insertions in each priority queue Qi and Q2 and the vertices 
are partitioned into Q(y/B) clusters, the total I/O cost is 0{^SoTt{V)). We obtain the 
following lemma. 

Lemma 4.10. For a tree T , a minimum cut can he computed in 0{Sort{E) + {V/B)Sort{V)) 
I/Os, if at most two edges of it are in T. 

We execute the above operations for all trees in packing and hence obtain the fol- 
lowing theorem. 

Theorem 4.11. We can compute a minimum cut in 0{c{MSF{V,E) logE + Sort{E) + 
{V / B) Sortiy))) I/Os for the given undirected unweighted graph G, where c is the mini- 
mum cut value. 



4.5 The Data Structure 



From Lemma 4.7, we know that for every a-minimum cut, a < 3/2, there is at least 
one tree in the packing that crosses the cut at most twice. It has been shown that when 
a < 3/2, there can be at most O(V^) a-minimum cuts [52j . 

Our mincut algorithm computes the cut value corresponding to each edge and each 
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pair of edges in every tree of a packing. Once the mincut has been found, run the algorithm 
again. In this run, we identify all a-minimum cuts. 

We use a perfect hash function to map each a-minimum cut into a unique key. 
Recall that a cut is characterised by a vertex set partition. Use the hash key to store all 
a-minimum cut values with the respective tree edges and trees, in a hash table. 

If the total number of a- minimum cuts is k, then the size of the hash table is 0{k), 
and it can be constructed in 0{c{MSF{V, E) \ogE + Sort(E) + {V / B)^oit{V)) + Sort(A;)) 
I/Os. 

We can perform the following query in our data structure: given a cut (defined by 
a vertex partition), find whether the cut is a-minimum or not. We can answer the query 
by computing the hash key of the given cut. Looking up the table will require 0(1) I/Os 
on an average. Computing of the hash key requires 0(y/B) I/Os. 

Lemma 4.12. A data structure, containing all a-minimum cuts, for a < 3/2 can be 
constructed m 0{c{MSF{V, E) log E + Sort{E) + {V/B)Sort{V)) + Sort{k)) I/Os using 
0(k) space. The following query can he answered in 0{V/B) I/Os: Given a cut (a 
partition of the vertex set), find whether it is a-minimum or not. 

4.6 The Randomised Algorithm 

The I/O complexity of computing the minimum cut can be improved, if spanning trees 
from the packing are chosen randomly. We assume that the minimum cut is large and 
c > log^ V. We use ideas from [52 j. 

The maximum tree packing r is at least c/2. Consider a minimum cut X and a 
packing P of size r' = f3c. Suppose X cuts exactly one tree edge of rjr' trees in P, and 
cuts exactly 2 tree edges of ut' trees in P. Since X cuts at least three edges of the 
remaining trees in P, 

r]T' + 2ut' + 3{1-t]- v)t' < c 

3-2ri-i^ <l//3 

u>3-l/(3-2r] 

First assume that r] > ^^J y . Uniformly randomly we pick a tree T from our approx- 
imate maximal tree packing. The probability is 1/(2 log l^) that we pick a tree so that 
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exactly one edge of it crosses particular minimuni cut X. If we choose 2 log V trees, then 
the probability of not selecting a tree that crosses the minimum cut exactly once is 

1 N 2 log2 V 2 1 

1 \ log^ V 1 



1 < 2 i°g^ < 

2 logy; V 

Thus, with probability (1 — 1/V), we compute a minimum cut. 
Now suppose that tj < ^^^ y . Then, we have 

1 1 

z/ > 3 



(3 logy 

Randomly pick a tree. The probability is v that we will pick a tree whose exactly two 
tree edges crosses the minimum cut. If we select logV^ trees from the packing then the 
probability of not selecting the right tree is 

^ ' -\\0 j \ogV) -V 

If (5 is small enough; for example /3 = 1/2.2. Therefore, we compute a minimum cut 
with probability 1 — IjV . This reduces the I/O complexity to 0{c ■ MSF(y, i?) \ogE + 
Sort(E) log2 V + |Sort(r) log V). 

4.7 On a (5- fat Graph 

A graph G is called a 5-iai graph for (5 > 0, if the maximum tree packing of G is at 
least ^ "^ ''^ W^ - ^^ c^^ compute an approximate maximal tree packing of size at least 
(1 + (5/2) (c/2) from our tree packing algorithm by choosing e = 2(i+s) ■ Since c is the 
minimum cut, a tree shares on an average 2/(1 + 6/2) edges with a minimum cut which 
is less than 2, and thus is 1. Hence, for a 6-ia.t graph, for each tree T we need only to 
investigate cuts that contain exactly one edge of T. Hence, the minimum cut algorithm 
takes only 0(c(MSF(V, E) log E + Sort(-E'))) I/Os; this is dominated by the complexity of 
the tree packing algorithm. 

4.8 The (2 + e)-minimum cut algorithm 

In this section, we show that a near minimum cut can be computed more efficiently than 



an exact minimum cut. The algorithm (Figure 4.6) is based on the algorithm of 



and computes a cut of value between c and (2 + e)c, if the minimum cut of the graph is c. 
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1. Let Aj^jj^ be the minimum degree of graph G. 

2. k = ^ for e > 0. 

3. find sparse /c-edge connected certificate H (see below for definition). 

4. construct graph G' from G by contracting edges not in H and recursively find the 
approximate minimum cut in the contracted graph G'. 

5. return the minimum of Aj^j^^ and cut returned from step 4. 



Figure 4.6: Approximate minimum cut algorithm 



We omit the correctness proof here. It can be found in [53]. The depth of recursion 
for the algorithm is 0{\ogE) [53] and in each iteration the number of edges are reduced 
by a constant factor. Except for step 3, each step can be executed in Sort(£') I/Os. Next, 
we show that step 3 can be executed in 0{k ■ MSF(V, E)) I/Os. 

A fc-edge-certificate of G is a spanning subgraph H oiG such that for any two vertices 
u and V, and for any positive integer k' < k, there are k' edge disjoint paths between u 
and f in if if and only if there are k' edge disjoint paths between u and v in G. It is called 
sparse, if E{H) = 0{kV). There is one simple algorithm, given in J68j, which computes 
a sparse fc-edge connectivity certificate of graph G as follows. Compute a spanning forest 
Fi in G; then compute a spanning forest F2 in G — Fi, and so on; continue like this to 
compute a spanning forest Fi in G — ^i<j<iFj, until Fk is computed. It is easy to see 
that connectivity of graph H = Ui<i<kFi is at most k and the number of edges in H 
is 0{kV). Thus, we can compute a sparse k-edge connectivity certificate of graph G in 
0{k{MSF{V,E) + Sort(E)) I/Os. 

Since Xmm is 0{E/V) and the number of edges is reduced by a constant factor in 
each iteration, a total of 0{y ■ MSF(y,E)) I/Os are required to compute a cut of value 
between c and (2 + e)c. 
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4.9 Conclusions from this Chapter 

In this chapter, a minimum cut algorithm was designed exploiting the semi-duality be- 
tween minimum-cut and tree-packing. On sparse graphs, the I/O complexity of the second 
phase dominates. Computing the second phase of our algorithm in 0(Sort(i?)) I/Os in- 
stead of 0(^Sort(V) + Sort(-E)) would be an interesting nontrivial result. 

An approximate algorithm given in this chapter executes faster than the above. Can 
we improve the error in minimum cut further without compromising much on the I/O 
complexity? 
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Chapter 5 

Some Lower and Upper Bound 
Results on Interval Graphs 



5.1 Introduction 

External memory algorithms for restricted classes of graphs such as planar graphs, grid 
graphs, and bounded treewidth graphs have been reported. Special properties of these 
classes of graphs make it easier on them, in comparison to general graphs, to find algo- 
rithms for fundamental graph problems such as single source shortest paths, breadth first 
search and depth first search. A survey of results and references can be found in |85j . 

In a similar vein, we study interval graphs in this chapter. We present efficient ex- 
ternal memory algorithms for the single source shortest paths, optimal vertex colouring, 
breadth first search and depth first search problems on interval graphs. Note that opti- 
mal vertex colouring is NP-hard for general graphs. We give I/O lower bounds for the 
minimal vertex colouring of interval graphs, 3-colouring of doubly linked lists, finding of 
the connected components in a set of monotonic doubly linked lists, and 2-colouring of a 
set of monotonic doubly linked lists. 

5.1.1 Definitions 

A graph G = {V, E) is called an interval graph, if for some set ^3 of intervals of a linearly 
ordered set, there is a bijection / : V^ — )■ Q= so that two vertices u and v are adjacent 
in G iff f{u) and f{v) overlap. Every interval graph has an interval representation in 
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which endpoints are all distinct [39]. Hence, G can be represented by a set of endpoints 
£ of size 2 I Q= I, where, for each / G 3", there are unique elements /(/) and r(/) in £ 
corresponding respectively to the left and right endpoints of /. We define an "inverse" 
function X : £ ^ '^^ which gives the corresponding interval for each member of £. That 
is, if e is either /(J) or r{I) and / G S then, X(e) = I. We say that an interval Ji 
leaves an interval I2 to the left (resp. right) if /(/i) < l^h) < r{Ii) < r{l2) (resp., 
lih) < /(/i) < rih) < r(/i)). 

Interval graphs are perfect graphs [39]; that is, for an interval graph G = (V, E), and 
for every induced subgraph G' of G, the chromatic number of G' is equal to the clique 
number of G'. Interval graphs also form a subclass of chordal graphs [SH]; that is, every 
cycle of length greater than 3 has a chord, which is an edge joining two vertices that 
are not adjacent in the cycle. Vertex colouring of a graph means assigning colours to its 
vertices so that no two adjacent vertices get the same colour; this is minimal when the 
smallest possible number of colours have been used. A maximum clique is a largest subset 
of vertices in which each pair is adjacent. A clique cover of size k is a partition of the 
vertices V = Ai + A2 . . . + A^ such that each Ai is a clique. A smallest possible clique 
cover is called a minimum clique cover. 

The single source shortest paths (SSSP) problem on interval graphs is to computing 
the shortest paths from a given source vertex (interval) to all other vertices, where each 
vertex is assigned a positive weight; the length of a path is the sum of the weights of the 
vertices on the path, including its endpoints. 

A BFS tree of a graph G is a subtree T of G rooted at some vertex s such that for 
each vertex u, the path from s to m in T is a path of minimum number of edges from s 
to M in C A DFS tree of an undirected graph G is a rooted subtree of G such that for 
each edge {u,v) in G, the least common ancestor of u and v is either u or v. The breadth 
first search and depth first search problems are to compute a BFS tree and a DFS tree 
respectively. 

A doubly linked list is a directed graph in which both the out-degree and in-degree 
of a vertex can be at most two. The vertices are given in an array (say A) and each vertex 
has a pointer to the next vertex and previous vertex. Thus A[i] = {k,j) will mean that j 
is a successor of i and A; is a predecessor oi i. li j > i and j is the successor of i then the 
z-to-j pointer is said to be "forward" , otherwise (if j < i and j is successor of i) it is said 
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to be "backward" pointer. A stretch of forward (backward) pointers starting from say i 
is a maximal collection of nodes which can be reached from i by traversing only forward 
(backward) pointers. Any doubly linked list will have alternate stretches of forward and 
backward pointers. 3-colouring a doubly linked list(denoted as "3LC") is the problem of 
vertex colouring a list with 3 colours. 

Assume that the vertices of a doubly linked list are numbered in some order. The 
doubly linked list is called monotonic if the vertex numbered v can be a successor of 
the vertex numbered u if and only ii u < v. That is, when the vertices of the list are 
arranged left to right in increasing order of their numbers, all the links are from left 
to right for successor pointers and right to left for predecessor pointers. MLCC is the 
problem of labelling each node in a collection of disjoint monotonic doubly linked lists, by 
the first element of the corresponding list and 2MLC is the problem of vertex colouring 
each monotonic doubly linked list with 2 colours. 

5.1.2 Previous work 

External memory algorithms have been designed for many fundamental graph prob- 
lems. All known external memory algorithms for the single source shortest paths (SSSP), 
breadth first search (BFS), and depth first search (DPS) problems on general graphs per- 



form well only for dense graphs. See the results and references in [85j; also see Table 5.1 
For many graph problems a lower bound of f2(min{V", ^Sort(V)}) on I/Os applies ^E\. 

Some restricted classes of sparse graphs, for example planar graphs, outerplanar 
graphs, grid graphs and bounded tree width graphs, have been considered in designing 
I/O efficient algorithms for SSSP, DPS and BPS. Exploitation of the structural properties 
of specific classes of sparse graphs has led to algorithms for them that perform faster than 
the algorithms for a general graphs. Most of these algorithms require 0(Sort(V^ + -^)) 
I/Os. See the results and references in |85j . 

Por any constant k, the set of graphs of tree width k includes all interval graphs with 
maximum clique size k. Por bounded tree width graphs, we can compute SSSP, BPS and 
DPS, and also some other problems that are known to be NP-hard for general graphs in 
0{Sort{E + V)) I/Os [59]. 

Interval graphs form a well-known subclass of perfect graphs and have applications in 
archeology, biology, psychology, management, engineering, VLSI design, circuit routing, 
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Problem 


Result 


References 


Single source shortest 
problem 


o(^^J^\ogV + MSF{V,E)'^ 


[64j 


Breadth first search 


U{VE)/B + Sort(E) + SF(y, E)) 


[M] 


Depth first search 


(min{\/ + Sort(E) + {VE)/M, {V + E/B) 


logy}) 


mm\ 



Table 5.1: Previous Results: The term SF(V,E) and MSF(V,E) represent the 1/0 bounds 
for computing spanning forest and minimum spanning forest respectively. 

file organisation, scheduling and transportation [39j. A lot of work have been done in 
designing sequential and parallel algorithms for various problems on an interval graph 

List ranking is a well-known problem. A known lower bound on 1/Os for this problem 
is f2(Perm(A^)) [20j, where A^ is the size of the linked list and Perm(A^) is the number 
of 1/Os required to permute A^ elements. The best known upper bound on 1/Os for list 
ranking and 3 colouring of lists is 0(Sort(A^)) [20] . 

5.1.3 Our Results 

We present some the lower and upper bound results on interval graphs. The results are 
described below and summarised in Table 15. 2[ 

Lower Bound Results 

We show that finding the connected components in a collection of disjoint monotonic 
doubly linked lists (MLCC) of size V is equivalent to the minimal interval graph colouring 
(IGC) problem on an interval graph whose interval representation is given. The number 
of 1/Os needed for both are shown to be r2(^ logAf/s b); where x is the chromatic number 
of an interval graph, or the total number of disjoint monotonic doubly linked lists, as 
is relevant. We also show that 3-colouring of a doubly linked list (3LC) of size V is 
reducible to 2-colouring of a set of disjoint monotonic doubly linked lists (2MLC) in 
0(Scan(V) + Sort(x)) 1/Os. It is also shown that 2MLC and 3LC of sizes V each have 
lower bounds of VLi^log^.ji^ ^) on 1/Os, where x is the number of disjoint monotonic 
doubly linked lists, and the total number of forward and backward stretches in the doubly 
linked list respectively. 
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Problem 


Notes 


I/O Bound 


SSSP 


input is a set of intervals 


0{SoTt{V)) 


BFS 


input is a set of intervals in sorted order 


0(Scan(V)) 


DFS 


input is a set of intervals in sorted order 


0(JSort(x)) 


IGC 


input is a set of intervals in sorted order 


0(|logM/B|) 


3LC, 2MLC, MLCC 




0(^Sort(x)) 


IGC, MLCC, 3LC, 2MLC 




^(ilogA//Bi) 



Table 5.2: Our Results 



Upper Bound Results 

• SSSP and BFS/DFS tree computations: We present an SSSP algorithm 
that requires 0(Sort(l^)) I/Os, and an BFS tree computation algorithm that re- 
quires 0(Scan(V)) 1/Os, and an DFS tree computation algorithm that requires 
0( — Sort(x)) 1/Os. The input graph is assumed to be represented as a set of inter- 

A 

vals in sorted order. 



minimally vertex colouring interval graphs (IGC): We show that IGC can 
be computed in an optimal 0{^logj^/^ ^) 1/Os, if the input graph is represented 
as a set of intervals in sorted order. 

Algorithms for 3LC, 2MLC, and MLCC Problems Optimal algorithms are 
given for 3LC, 2MLC, MLCC problems. 



5.1.4 Organisation of This Chapter 



In Section 5.2, we present the lower bound results on MLCC, IGC and 3LC problems. In 



Section 5^, the algorithms for finding chromatic number and minimal vertex colouring 
problems are given. The algorithms for SSSP, BFS and DFS are given respectively in 



Section 5.5, and Section 5.6 
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5.2 The Lower Bound Results 

In this section, we discuss the lower bound results for MLCC, 2MLC, 3LC, and IGC 
problems. 

5.2.1 Equivalence of MLCC and IGC 

A Reduction from MLCC to IGC 

Consider an instance of MLCC of size V with K components, given in an array yl[l . . . l^] 
such that for each A[i], its successor and predecessor both are stored in A[i]. From this 
instance we construct an equivalent instance of IGC as follows. 

Allocate an array D[1...2K + V]. Copy A[l . . . V] into D[K + 1, . . . K + V]. While 
copying, offset every pointer by K so that it continues to point to the same element as 
before. Scanning D in order from location K + 1 to K + V, ior 1 < j < K, make D[j] 
the predecessor of the j-th headnode in D[K + 1, ... K + V], and make D[K + V + j] the 
successor of the j-th lastnode in D[K + 1, ... K + V]. Accordingly, define successors and 
predecessors for the nodes in D[l . . . K] and D[K + V + 1 . . . 2K + V]. (A headnode is a 
node without a predecessor, and a lastnode is a node without a successor.) Now D holds 
in it a set of K monotonic linked lists so that every headnode is in D\i . . . K] and every 
lastnode is in D[K + V + 1 .. . 2K + V]. 0{Scan{V)) I/Os are enough to prepare D as 
stated above. 

Construct a set 3" of intervals such that, ioT 1 < i,j < V + 2K, if the successor of 
D[i] is D[j] then add /, = [i,j — |] to Q". /(/j) = i, and r(/j) = j — |- For every integer 
i in D[l . . . K + V], i is a left endpoint, and for every integer j in D[K + 1 .. . 2K + V], 
j — I is a right endpoint. The successor (predecessor) pointers give the corresponding the 
right (left) endpoint for each left (right) endpoint. An instance of IGC can be constructed 
from these intervals in 0(Scan(V + 2K)) I/Os. 

Consider the interval graph G defined by 0=. Identifying each component of D with 
a unique colour, we get a valid colouring of G; that is, x(G') < K. Now, suppose, there 
is an optimal colouring of G that for two consecutive edges {u,v) and {v.,w) of D., gives 
different colours to their corresponding intervals /„ = [u,v — ^] and I^ = [v,w — ^] in G. 
But, all endpoints are distinct. There is no endpoint between f — | and v. Both /„ and 
/f, share K — 1 mutually adjacent neighbours. Therefore, and we get x{G) = K + 1 > K, 
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a contradiction. That is, an optimal colouring of G will use one colour per component of 
D. In other words, x(G') = K and any optimal colouring of G will identify the connected 
components of -D, and hence of A. Thus, we have the following lemma. 

Lemma 5.1. An instance of MLCC of size V with K components can he reduced to an 
instance of IGC of size 0{V) and chromatic number K , in 0{Scan(y)) I/Os. 

A Reduction from IGC to MLCC 

A in-core algorithm for IGC is easy to visualise. Let Q be a queue of size x{G), which is 
initialised with all the available x{G) colours. Consider the endpoints of the intervals one 
by one in non-decreasing order. For each left endpoint encountered, remove a colour from 
the front of Q and colour the corresponding interval with it. For each right end point, 
release the colour of the corresponding interval onto the back of Q. When the last left 
endpoint is considered, the graph would be coloured. 

We attempt a reduction of IGC to MLCC using this algorithm. Let L = {li, . . . ,lv} 
and R = {ri, . . . , ry} respectively be the sets of the left and right endpoints of the intervals 
given in non-decreasing order. For each interval /, the rank of r(/) (resp. /(/)) is stored 
with /(/) (resp. t(/)) in L (resp. R). For 1 < i < V, let ti be the rank of r^ in L. 
That is, /i < . . . < /f. < Ti < It^+i- So, when r^ releases the colour of the interval X(rj) 
onto the back of Q, ti left endpoints and i right endpoints would have been encountered 
and the length of Q would be x{G) — ti + i. Hence, the colour released by rj will be 
taken up by the (x(G') — tj + i)-th. left endpoint from now on; that is, by the left endpoint 
lt-+^^(G)~u+i = ^x(G')+j- I^ other words, both X(rj) and X{l^i^G)+i) are to get the same colour, 
and no interval with a left endpoint between their respective left endpoints will get that 
colour. 

Define the successor and predecessor of each L[i] as follows: let succ(/j) be 1^(g)+ji 
ioi 1 < i < V , where X(/j) = T{r-j) and pred(/i) be /(X(rj_^(G'))), for x(G') < i < V. 
For 1 < i < x{G)-, each /j is the headnode of a monotonic linked list. It is clear that 
this defines a collection of monotonic linked lists over L. Once we find the connected 
components in this collection we have got an optimal colouring of the graph. We can 
obtain monotonic linked lists in 0(Scan(V)) I/Os as follows: for each interval /, rank of 
r(/) (resp. /(/)) is stored with /(/) (resp. t(/)) in L (resp. R). The successor of each /j 
can be computed in one scan of L. To compute the predecessors, scan L and R together. 



with the scan of R staying x{G) nodes behind, and set for each /«, Z(X(rj_^(G'))) as the 
predecessor of k. Thus, we have the following lemma: 

Lemma 5.2. IGC can be reduced to MLCC in 0{Scan{V)) I/Os. 

Therefore, 

Theorem 5.3. IGC is equivalent to MLCC on the external memory model. 

5.2.2 Lower Bounds for 2MLC and MLCC 

The lower bounds for 2MLC and MLCC are obtained by showing each problem equivalent 
to a modified split proximate neighbours problem. The split proximate neighbours (SPN) 
problem is defined as follows: "Given are two arrays A and B, each a permutation of size 
K of elements from the range [1,K] so that for each i in [1,-?^], the occurrences of i in 
A and B know the addresses of each other. Permute AU B so that for each i, the two 
occurrences of i are stored in the same block." Without loss of generality, we can assume 
that A is sorted. The following lower bound is known for this problem: 

Lemma 5.4. [2U[ [gP| / The split proximate neighbours problem requires Q{Perm{K)) I/Os 
for an input of size 2K , where Perm[K) is the number of I/Os required to permute K 
elements. 

The assumption that for each i, the occurrences of z in A and B know the addresses 
of each other does not make the problem any easier. This assumption is akin to assuming 
that in the permutation problem each element in the input knows its position in the 
output. See [21 EH]- 

Consider a set S* of ^ independent instances of SPN of size K > M each. Let 
V be the problem of solving all instances of S. A lower bound for V is fi(^Perm(if)). 



This follows from Lemma 5^, and the fact that A^ cannot be greater than K\ because 
A^ < B{M/B)^ when Sort(A^) < A^. 

Create a set of K monotonic linked lists from V as follows. For alH, 1 < i < K, and 
for all j, 1 < j < N/2K, let the successor (resp. predecessor) of the i in Aj be the i in 
Bj (resp. -Bj-i), and let the successor (resp. predecessor) of the i in Bj be the i in Aj+i 
(resp. Aj). For alH, 1 < z < K, let the successor (resp. predecessor) of the i in An/2k 
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(resp. Ai) be NULL, and let the predecessor (resp. successor) of the i in An/2K (resp. 
Ai) be the i in Biy/2K-i (resp. Bi). 

Consider solving the above MLCC instance C. We claim that during the execution of 
any MLCC algorithm, every link of C has to come into the main memory. Suppose this is 
wrong. Then an adversary can cut an edge e that does not come into the main memory; 
the algorithm would still give the same output, even though the number of connected 
components has increased. 

Whenever the link from the i in Aj to the i in Bj comes into the main memory, 
make a copy of the two occurrences of i into a block. When block becomes full, write it 
into the external memory. Thus, with an extra N/B I/Os, problem V is also computed 
during the execution of an algorithm for MLCC. Thus the lower bound of V also holds 
for MLCC. 

The same argument holds for 2MLC, and 3LC too. Therefore, 

Theorem 5.5. Each of IGC, 3LC, MLCC and 2MLC require n{^SoH{K)) I/Os on the 
external memory model. 

5.3 The Algorithms for 3LC, 2MLC, and MLCC 

Note that each node of the given doubly linked list knows both its predecessor and suc- 
cessor. A general doubly linked list L, given in an array A, can be visualised as being con- 
stituted of alternating stretches of forward and backward pointers in an array (described 



in Subsection 5.1.1), and hence can be decomposed into two instances of 2MLC, one con- 
sisting only of forward stretches and the other consisting only of backward stretches. Let 
L' and L" be the 2MLC instances formed by the forward and backward stretches of L, 
respectively. Invoke a 2MLC algorithm on each. The output of the 2MLC invocations 
can be used to 4-colour L as follows: for each node x in L, colour x with "a6" if a and b 
are the colours (0 or 1) of x in L' and L" respectively. 

Each node v, if v has both a successor and a predecessor in L', can infer their colours 
in L' from its own colour; if v is coloured 0, they are coloured 1 and vice versa. There 
are at most 2% nodes in L' with a forward predecessor or a backward successor, where 
X is the total number of forward and backward stretches in L. In one pass, isolate these 
nodes, sort them and inform each of them the colours of its successor and predecessor. 
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Now every node knows the colours of its successor and predecessor in L' . Process L" in a 
similar fashion. All of this takes only 0(Scan(\/) + Sort(x)) I/Os. 

A 4-colouring can be reduced to a 3-colouring in one scan of A as follows: for each 
vertex of colour 4, assign it the smallest colour not assigned to its predecessor or successor. 
This can be done in a single scan of A. 

Thus, 3LC can be reduced to 2MLC in 0(Scan(\/) + Sort(x)) I/Os. 

2MLC can be solved as follows: Maintain a priority queue PQ. Scan the array A. 
For each node A[i\, if A[i\ is a headnode, then give it a colour c of 0; otherwise, perform 
deletemin on PQ to know the colour c of A[i\\ if A[i\ is not a lastnode, then give colour 
1 — c to its successor A[j], and insert 1 — c with key j into PQ. At any time, PQ holds 
at most X colours. The total number of I/Os needed is, therefore, 0(^logM ■^). The 
same algorithm can be used in computing MLCC also with a change in colouring each 
headnode uniquely, and sending the same colour to successor. 

That is, a linked list can be 3-coloured in 0(^logM ■^) I/Os, where x is the total 
number of forward and backward stretches in L. 

5.4 An Interval Graph Colouring Algorithm 

First, we consider a problem closely related to IGC, namely, that of finding the chromatic 
number of an interval graph with a known interval representation. 

5.4.1 Finding the Chromatic Number 

Let an interval graph G = (V, E) be represented by L = {/i, . . . , ly} and R = {ri, . . . , ry} 
the left and right endpoints of the intervals of G given in non-decreasing order. The 
sequences L and R can be cross ranked in one scan. For 1 < i < V", let Si be the rank of /» 
in R. That is, ri < . . . < r^^ < k < Ts^+i- Then, i — Si {= ti say), is the size of the chque 
formed precisely by those intervals that contain /j. In other words, tj is the size of the 
clique that X(/j) forms along with its in-neighbours, if each edge thought to be directed 
away from the interval with the smaller left endpoint. Observe that any maximal clique 
C of an interval graph should contain a vertex f , such that the set of all in-neighbours 
of V is precisely the set C — {f }. Thus, the chromatic number of G can be obtained by 
taking the maximum of tj over all i and we have following lemma. 
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Lemma 5.6. The clique number of an interval graph can be found in 0{Scan{V)) I/Os 
on the External Memory model, provided, the left and right endpoints of the intervals are 
given in sorted order, separately. 

5.4.2 The IGC Algorithm 



Our algorithm is based on the sequential algorithm given in Subsection 5.2.1 We assume 
that left and right endpoints of all intervals are stored together in an array A in sorted 
order, and for each interval /, the left end point /(/) knows the right endpoint r(/). The 
algorithm executes the following steps: 



1. Find the chromatic number x{G) using the algorithm given in Section 5.4.1 

2. Initialize an external memory queue Q [71] with all the available x{G) colours. 

3. Read the endpoints from A in order. 

4. For each left endpoint /(/) encountered in A, remove a colour from the front of Q, 
colour interval / with it, and insert this colour with the right endpoint r(/) into a 
priority queue PQ with r(/) as the key. 

5. For each right endpoint r(/) encountered in A, obtain the colour of / from PQ using 
a deletemin operation, insert this colour onto the back of Q. 

When the last of the endpoints is considered, graph would be coloured. The sizes of PQ 
and Q can be at most x{G) at any time. The I/O complexity of PQ operations dominates 
the I/O complexity of Q operations. There are V insertions and V deletions. Therefore 
Algorithm colours the graph in 0(^ logM ^^) I/Os [7J. The correctness of the algorithm 
comes from the in-core algorithm given in section |5.2.1[ 

Lemma 5.7. An interval graph can be coloured in 0(^logM ^^) I/Os, provided that 
the left and right endpoints of the intervals are given in sorted order, and each left end- 
point knows the rank of the corresponding right endpoint, where V is the total number of 
intervals. 
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5.5 Single Source Shortest Paths 

For the shortest paths problem, we consider a weighted set of intervals 9 such that each 
interval Jj is assigned a positive weight w{Ii). A path from interval Jj to Ij is a sequence 
p = {/t,^, . . . /t,j} of intervals in Q=, where I^^ = Ji, J„; = Ij, and any two consecutive 
intervals, I^^ and Ivr+i overlap for every r E {1, . . .1 — 1}. The length of p is the sum of 
the weights of its intervals, p is a shortest path from li to Ij, if it has the smallest length 
among all possible paths between Jj to Ij in 0=. The single source shortest paths problem 
is that of computing a shortest path from a given source interval to all other intervals. 

We assume, without loss of generality, that we are computing the shortest paths 
from the source interval to only those intervals that end after the source begins (in other 
words, have their right endpoints to the right of the left endpoint of the source). The same 
algorithm can be run with the direction reversed to compute the shortest paths from the 
source interval to those intervals that begin before the source ends; the neighbours of the 
source feature in both sets, and will get assigned the same values in both computations; 
the two computations together will give the shortest paths to all intervals from the source. 

Computing, thus, only in one direction, we can also assume that every interval that 
intersects the source interval Ig begins after Ig. This would enable us to assume, without 
loss of generality, that Ig has the smallest left endpoint of all intervals. 

5.5.1 The Algorithm 

As discussed above, we assume that Is has the smallest left endpoint. Suppose all intervals 
are stored in an array A in sorted order of left endpoints. (Otherwise, sort them in 
0{SoTt{V)) I/Os). Let the intervals in sorted order he Ig = h, ■ ■ ■ , ly, where Jj = (li,ri) 
and li (resp. r^) denotes the left (resp. right) endpoint of Jj. Let di be the shortest 
distance of an interval Jj from the source interval Ji. 

Initially, set di = wi for Ji. For each Jj such that li < k < ri, set di = di + w{Ii), 
and the parent of /« to Ji. If r^ > ri, then insert {di, li) in a priority queue PQ with di as 
the key. Then execute the following steps. 

set r = Ti] 

while PQ is not empty 
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perform a deletemin operation on PQ] let {di,Ii) be the record returned; 
for every Ij G A such that r < Ij < ri 

set dj = w{Ii) + w{Ij), and the parent of Ij to li 

If Vj > Ti then 

insert dj with Ij in PQ with key value dj\ 
set r = max{r, Tj}; 

It is easy to see that random access is not required in A, because after each deletemin the 
scan of A resumes at r. Since, each interval is inserted in PQ exactly once, we perform V 
deletemin and insert operations in PQ. The amortised I/O complexity of each operation 
is 0(^logM ^) (See Chapter 3). Thus, shortest paths can be computed in 0(Sort(V^)) 
I/Os. 

The correctness of the algorithm follows from this lemma: 

Lemma 5.8. JiOj / // there exists a shortest path from Ii -^ Jj then all intervals in this 
path covers a contiguous portion of the line from /i to r^. 

Lemma 5.9. For each interval Ii, di is the shortest distance from the source interval /i 
to Ii. 

Proof. For two intervals Ij and Iji, our algorithm chooses Ij as the parent of Iji because it 
is the nearest to Ji (has the smallest d- value) of all intervals that contain the left endpoint 
of Iji. Therefore, if dj is the shortest distance to Ij, then dji is the shortest distance to Iji. 
The (i- values of all neighbours of Ji indeed match their shortest distances from Ji. D 

While computing shortest distances, our algorithm computes the shortest paths tree 
also. 

Given a set of V weighted intervals and a source interval, a shortest path of each 
interval from the source interval can be computed using our algorithm in 0(Sort(V^)) 
I/Os. 

5.6 Breadth First Search and Depth First Search 

Here we show how to compute a breadth first search tree and depth first search tree for an 
interval graph in 0(Scan(\^)) I/Os, if intervals are given in sorted order of left endpoints 
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i.e. $5 = {/i, I2, ■ . ■ ly}- We assume, without loss of generality, that source vertex is Ji 

5.6.1 Breadth First Search 

To begin with, interval Ji is assigned as the parent of the intervals whose left endpoints 
are contained in Ji. Among those selected intervals, we find an interval Ij whose right 
endpoint is maximum. This interval Ij is assigned as parents of the remaining intervals 
whose left endpoints are contained in Ij, and for whom a parent has not been assigned 
yet. We repeat this process until no interval is left. The resulting tree is a BFS tree. 
Since we have to scan Q" once, the BFS tree is computed in 0{Scan{V)) I/Os. 

5.6.2 Depth First Search 

To find a depth first search tree, an interval Ij is assigned as the parent of an interval Jj, 
if Ij has the largest left endpoints among Ik such that Ik < U < rk, that is, the parent 
of an interval is its youngest older neighbour if the intervals are assumed to be on the 
timeline. Note that this scheme indeed defines a DPS tree, because if the resultant tree 
has a cross edge from a "older" interval /„ to an "younger" interval J„, then it can be 
shown that a proper ancestor of I^ that is lower than the lowest common ancestor of /„ 
and ly failed to choose /„ as its parent as it ought to have. To compute the tree, scan the 
endpoints from the smallest to the largest, while maintaining the set of open intervals in 
a priority queue PQ with left endpoint as key. Whenever, a left endpoint / is encountered 
use a Findmax operation on PQ to find the youngest interval open at that point in time. 
After, thus defining the DPS parent of X(/), insert X{1) into PQ with key /. Whenever 
a right endpoint r is encountered, delete X(r) from PQ. Therefore, a DFS tree can be 
computed in 0(^ logM ^) I/Os. 

5.7 Conclusions from this Chapter 

In this chapter, we present lower and upper bound results for many problems on an interval 
graphs. Once an interval representation is given for an interval graph, various problems 
like SSSP, BSF and DFS become easier. External memory algorithms for interval graph 
recognition, and computing of an interval representation of the given graph are yet to be 
found. 



Part II 

Algorithms on the W-Stream Model 

and its Variants 
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Chapter 6 

Some Algorithms on the W-Stream 
Model 



6.1 Introduction 

In this chapter, we discuss the designing of W-Stream algorithms for sorting, hst ranking, 
and some fundamental tree and graph problems. A lower bound of Q{N/{M log N)) on 
passes is known for some of these problems [2H1 1221 [77] , where N is either the number of 
elements in the input stream or the number of vertices, the latter if the input is a graph. 
The number of bits available in the working memory is M log A^. We shall often refer to 
the working memory as just the memory. For sorting and the graph problems considered, 
we give improved upper bound results. For list ranking and the tree problems, we present 
algorithms that are easier than the known ones to implement, and perform as well. Lower 
bounds for some problems are also established. 

The tree problems considered are the finding of Euler tours of trees, rooting of trees, 
labelling of rooted trees, and expression tree evaluation. The graph problems considered 
are the finding of a maximal independent set, a (A + 1) colouring, a maximal matching, 
a 2-approximate vertex cover, and e-approximate single source shortest paths. 

6.1.1 Definitions of the Problems 

Sorting : The problem is to arrange in order a set of elements drawn from a linearly 
ordered set. 
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List ranking : A linked list is a directed graph in which both the out-degree and in- 

degree of a vertex can be at most one. A vertex of zero in-degree is called the head of the 

list. The vertices are given in an array and each vertex x has a pointer to the next vertex 

y [231 EH]- The rank of a vertex x in the list is the number of edges on the path from the 

head of the list to x. The list ranking problem is to compute the rank of each vertex in 

the list. 

Euler tour of a tree: A tree is an acyclic graph. An Euler Tour of a tree is a traversal 

of its edges that starts and ends at one distinguished vertex s and traverses each edge 

exactly twice. 

Rooting of a tree : A tree is rooted, if its edges are directed so that for each vertex 

X other than a distinguished vertex s called the root, the out-degree of x is one. The 

out-neighbour of x is the parent of x. The rooting of a tree is the process of so directing 

the edges. 

Labelling of a tree : Some of the labellings we consider are preorder numbering, pos- 

torder numbering, finding of the depths and the number of descendants of each vertex. 

Expression tree evaluation : In an expression tree, each internal vertex is labelled 

by a function which can be computed in 0(1) time and each leaf is labelled by a scalar. 

A leaf evaluates to its scalar. The value at an internal node is obtained by applying its 

function to the values of its children. The problem is to compute the values at all vertices 

in the tree. 

Maximal independent set: Given a graph G = {V,E), a subset / of V is called an 

independent set, if no two vertices in I are adjacent in G. The maximal independent set 

problem is to compute an independent set which is closed under inclusion. 

(A + 1) -colouring of a graph: The problem is to assign one of A + 1 colours to each 

vertex so that no two adjacent vertices get the same colour, where A is the maximum 

vertex degree of the graph. 

e- Approximate single source shortest paths: Given a weighted graph G = {V, E) 

with a non- negative integer weight for each edge and a source vertex s, the single source 

shortest paths problem (SSSP) is to compute, for each vertex v E V, a shortest path from 

s to V. A path P from s to f is called an e-ap proximate shortest path, if the length of P 

is at most (1 + e) times the length of a shortest path from s to v. 

Maximal matching: Given a graph G = {V, E) , a subset of E is called a matching, if no 
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two edges of it have a common endpoint. The maximal matching problem is to compute 
a matching which is closed under inclusion. 

2- Approximate vertex cover: Given a graph G = (V, E) with positive weight at each 
vertex, a subset 5 of V is called a vertex cover, if each edge has at least one endpoint 
in S. The 2-approximate vertex cover problem is to compute a vertex cover of weight at 
most two times the weight of a minimum vertex cover. 



6.1.2 Previous Results 

On the W-Stream model, sorting has a lower bound of r2(A^/(Mlog A^)) on passes |77j . 
The best known algorithms take 0{N/M) passes [281166]. Both algorithms |28l[66] perform 
0{N'^) comparisons. The total Number of comparisons can be reduced to the optimal 
O(A^logA^) at the cost of increasing the number of passes to 0((A^log A^)/M) using a 
simulation of an optimal PRAM algorithm [2S]. But in this case, the total number of 
operations is 0((A^ log A)/M), where each reading or writing of an element into the 
memory counts as an operation. 

List ranking, Euler tour of trees, rooting of trees, labelling of trees and expression 
tree evaluation can all be solved in 0{N/M) passes using simulations of optimal PRAM 
algorithms |l8], as shown in [28]. 

The lower bound for the maximal independent set problem is Q{V/{MlogV)) on 
passes [28] when the input is an unordered edge list. The best known algorithm uses 
0(l^log V"/M) passes to find a maximal independent set with high probability, when the 
input graph is presented as an unordered edge list. 

The lower bound for the SSSP problem is Q{V/{M\ogV)) on passes [29j, when the 
input graph is presented as an unordered edge list. The best known SSSP algorithm [29] 
executes in 0{{CV\ogV)/\/M) passes and finds shortest paths with high probability, 
where C is the maximum weight of an edge, and log C = 0(log V). This algorithm is not 
very efficient for large weights. This algorithm can also be used for performing a breadth 
first search (BFS) of the graph in 0{(y log V)/y/M) passes with high probability. These 
algorithms assume that the input graph is given as an unordered edge list. 
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6.1.3 Our results 

In this chapter, we present the following results. 

• Lower bounds of r2(A^/(Mlog A^)) on passes for list ranking and maximal matching. 
A lower bound for list ranking also applies to expression tree evaluation, finding the 
depth of every node of a tree, and finding the number of descendants of every node 
in a tree. 

• An algorithm that sorts A^ elements in 0{N/M) passes while performing 0{N log M+ 
N'^/M) comparisons and 0{N'^/M) elemental reads. Our algorithm does not use a 
simulation, and is easier to implement than the earlier algorithms. 

• Algorithms for list ranking, and tree problems such as Euler Tour, rooting of trees, 
labelling of rooted trees and expression tree evaluation that use 0{N/M) passes 
each. Unlike the previous algorithms, our algorithms are easy to implement as they 
do not use simulations. 

• Algorithms for finding a maximal independent set and a A + 1 colouring of graphs. 
We show that when the input graph is presented in an adjacency list representa- 
tion, each can be found deterministically in 0{V/M) passes. We also show that 
when the input is presented as an unordered edge list, each can be found deter- 
ministically in 0{V/x) passes, where x = 0(min{M, ^/A^\ogV}) for MIS, and 
X = 0(min{M, ^MhgV, fg^}) for A + 1 colouring. 

• Algorithms for maximal matching and 2-approximate weighted vertex cover that are 
deterministic and require 0{V/M) passes. The vertex cover algorithm assumes that 
the weight of each vertex is V'^'^^\ The input here is assumed to an unordered edge 
list. The lower bound of maximal matching problem is shown to be Q{V/{M log V)) 
on passes. 

• An algorithm that, for all vertices v E V, computes with high probability an e- 
shortest path from a given source vertex s to f in 0( — °^ /tj^ — ) passes, where W 
is the sum of the weights of all edges. We assume that log W^ = 0(\ogV). If C is 
the maximum weight of an edge, then W < VC, and our algorithm improves on 
the previous bound by a factor of C/ \og{VC) at the cost a small error in accuracy. 
Here again, we assume the input to be given as an unordered edge list. 
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6.1.4 Organisation of This Chapter 



In Section 6.2 , we prove lower bounds for the list ranking and maximal matching problems. 



In Section |6.3[ we present algorithms for the various problems mentioned above. In 

we 



particular, in Subsection 6.3.1 we present a sorting algorithm. In Subsection 6.3.2 



give a list ranking algorithm. In Subsection 6.3.3 we present several tree algorithms. 



In Subsection 6.3.4, we present algorithms for the maximal independent set and (A + 



1) colouring problems. In Subsection 6.3.5, we give an approximate SSSP algorithm, 



and in Subsection |6.3.6| and |6.3.7[ we present algorithms for maximal matching and 2- 
approximate weighted vertex cover, respectively. 



6.2 The Lower Bound Results 



In this section, we prove lower bounds for the list ranking and maximal matching prob- 
lems. The lower bound for each problem P is proved by reducing the bit-vector disjoint- 
ness problem V to P. Results on the bit-vector disjointness problem in Communication 
Complexity have been proved useful in establishing lower bound results for problems on 
the streaming model 03] . In this problem, two players A and B have bit vectors a and b 
respectively, each of length A^. Player B wants to know if there exists an index i such that 
ttj = 1 and bi = 1. It is known that this problem requires Q{N) bits of communication 
between A and B [73]. Let ai, . . . , a^r, 6i, . . . , fo^r be an instance of V. On the W-Stream 
model, between one pass and the next over the sequence, at most 0(M log A^) bits of 
information can be transferred between the two halves of the input. Any algorithm that 
solves V in o(A^/(Mlog A^)) passes would, therefore, cause o{N) bits to be transferred 
between the two halves. That is, fi(A^/(Mlog A^)) is a lower bound on the number of 
passes for V on the W-Stream model. 

First we show a reduction of P to the list ranking problem. Assume that the input 
Id to "D is a bit sequence Oi, . . . , ajy, 6i, . . . , 6jv. Our reduction constructs a set L of lists 
with {ai, . . . , ajy, 6i, . . . , bjy} as its vertex set. We define the successor function a on the 
vertices of L as follows: For I < i < N, a{ai) = bi, and a{bi) = Oj+i. The list can be 
formed in 0(1) passes on the W-Stream model. Invoke a list ranking algorithm on this 
list. If the list ranking algorithm is one that exploits the associativity of addition for its 
correctness, then at some point in the algorithm, for every i, the link from a^ to cr(aj) 
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must be loaded into main memory; at this point in time, the hst ranking algorithm can 
say if Oj = 6j = 1; thus, any list ranking algorithm based on the associativity of addition 
can be amended to answer T) as an aside. Without this property we cannot guarantee 
that for every i, the link from a^ to criai) must be loaded into main memory. 

Thus the lower bound of T> applies to list ranking too. 

Next we show a reduction of T) to the maximal matching problem. We construct a 
graph whose vertex set is (ai, . . . cat, 6i, . . . , ^at, ci, . . . , cat, (ii, . . . , dN,xi, . . . ,XN,yi, ■ ■ ■ ^Vn) 
as follows: Add an edge {ai,di) into the edge set if Oj = 1, add two edges {ai,Xi) and 
(xj,Cj), otherwise. Add an edge {bi,di) if 6j = 1, add two edges {bi,yi) and {yi,Ci), other- 
wise. A maximal matching of this graph is of size exactly 2N if and only if both A and 
B do not have ai = bi = 1 for any i. Thus, the lower bound of V applies to the maximal 
matching problem too. 

A lower bound for list ranking also applies to expression tree evaluation, finding the 
depth of every node of a tree, and finding the number of descendants of every node in a 
tree. Therefore, we have following lemma. 

Lemma 6.1. The problems of list ranking, maximal matching, expression tree evaluation, 
finding the depth of every nodes of a tree, and finding the number of descendants of every 
node in a tree all require Q{N/{M log N)) passes on the W-Stream model. 

6.3 The Upper Bound Results 

6.3.1 Sorting 

Unlike the previous algorithms, our algorithm does not use a PRAM simulation, and 
hence is easier to implement. 

First, in one pass, we create N/M sorted sequences called runs, each of size M; the 
last run may be of a smaller size, if A^ is not a multiple of M. The total number of 
elemental reads and comparisons are Q{N) and ©(A^logM), respectively. 

Next, we perform log(A^/M) merge-phases, each of which 2-way merges consecutive 
pairs of runs in its input. 

At the beginning of the k-th merge-phase, we have N /2^~^M runs 

^1, Bi, A2, B2, . . . , Aj^/2kM, B]^/2kM 

96 



where each Ai and Bi is of size 2^~^M, except that the last run Biy/2kM niay be of a 
smaller size. We merge pairs {Ai, Bi) concurrently and store the partial result in an array 
Ci which is kept between Bi and Aj+i. Initially Cj is without elements. For each pair Ai 
and Bi, the following steps are executed: 

Read M/2 elements from Ai into the memory; let the rest of Ai stream through 
into the output. Read M/2 elements from Bi into the memory; let the rest of 
Bi stream through into the output. Merge these elements in-core. Keep Di, 
the merged array, in the memory. Merge Di with Ci, on the fly, as Ci streams 
in, and output the merged sequence as the new C^. 

In one pass, for all i, we move M/2 elements each of Ai and Bi into Ci, while keeping all 
three in sorted order. The size of Ci increases by M, and the sizes of Ai and Bi decrease 
by M/2 each. After 2^^ passes, Aj's and i?j's become empty, and we have N /2^M runs of 
size 2'^M each. Thus, the total number of passes required to reduce the number of runs 
from N/M to one is EL°f S^^^^ 2^ = 2(A^/M - 1) = 0{N/M) 

In the A;-th merge phase, in the j-th pass, we perform (1 + j)M comparisons for each 
pair. The total number of comparisons performed is 

logWM) 2" N f N^\ 

0{N\ogM)+ Y. ^(i+_^-)M-^^=0(iVlogM+ — 

k=l j=l ^ ^ 

The total number of elemental reads is, clearly, 0{N'^/M). 

6.3.2 List Ranking 

In this section, we present an algorithm that ranks a list of A^ nodes in 0{N/M) passes 
without using a PRAM simulation. It is assumed that the input list L is stored in an 
array A and each node of the list knows the addresses of its successor and predecessor. 
Each node u holds two variables w{u) and r{u) initialised to one and zero, respectively. 

Our algorithm repeatedly splices out sets of independent sublists from the remaining 
list, and then splices them back in, in the reverse order. 

Two sublists of a list L are independent if there is no link in L between a node in 
one and a node in the other. A set S of sublists of L is independent if its members are 
pairwise independent. The splicing out of a sublist L' = (ai, . . . , a^) involves setting the 
predecessor p{ai) of ai and the successor s{ak) of ak, respectively, as the predecessor and 
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successor of each other; it also involves adding W = J2i=i'^i'^i) ^o w{p{ai)). (In the 
above, a^ is the predecessor of ctj+i.) A later splicing in of the sublist involves a reversal 
of the above pointer arrangements; it also involves setting r{p{ai)) to r{p{ai)) — W, and 
then r{ai) to r(p(ai)) + X]i=i'^('^j)- The splicing in/out of a set of independent sublists 
involves the splicing in/out of its members individually, one after the other. 

Divide the array A into segments of size M each; the last segment may be of a size 
less than M. Repeatedly, load a segment into the memory. Splice out the sublist induced 
by the nodes of the segment. This can be done when the remaining nodes of the list 
stream by. When all the nodes have gone by, send the spliced out nodes too into the 
output. Thus in one pass the length of the list reduces by M. After N/M — 1 passes, the 
list would fit in the memory. Rank the list by computing a prefix sum of the w- values 
along it and storing the result in the corresponding r-values. Thereafter, splice in the 
segments in the reverse of the order in which they were removed. The list L would now 
be ranked. 

That is, a list of N nodes can be ranked in 0{N/M) passes. 

6.3.3 The Tree Algorithms 

In this section we show that a variety of fundamental problems on trees can be solved in 
0{N/M) passes without using PRAM simulations. Our algorithms are easy to implement 
and use sorting and list ranking procedures. In particular, we consider Euler Tour, rooting 
of a tree, labelling of a rooted tree and expression tree evaluation. 

Euler Tour 

An Euler Tour L of a tree T is a traversal of T's edges that starts and ends at the same 
vertex, and uses each edge exactly twice. Suppose T is presented as an unordered edge- 
list. Replace each edge e = {v, u} by two directed edges (f , u) and (m, f ); one is the twin 
of the other. Sort the resultant edge list on the first component of the ordered pairs. 
Then all outgoing edges of each vertex v come together. Number them consecutively: 
ei, . . . , Ck] let e,. -^. mod k ^^ ^^^ successor of Cj. For each {u, v), define next('u, v) as the 
successor of {v,u). The next pointers define an Euler tour of T [I8l [89] . They can be 
computed for all edges in 0{N/M) passes: load M edges into the memory; let the other 
edges stream through; when the twin of an edge {u, v) in the memory passes by, copy its 
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successor pointer as the next pointer of {u,v). Thus, M edges can be processed in one 
pass, and so, a total of 0{N/M) passes are required to compute the Euler tour. 

Rooting a tree 

The rooting of a tree T is the process of choosing a vertex s as the root and labelhng the 
vertices or edges of T so that the labels assigned to two adjacent vertices v and w, or to 
edge {v,w), are sufficient to decide whether v is the parent of w or vice versa. Such a 
labelling can be computed using the following steps: 

1 . Compute an Euler Tour L of tree T 

2. Compute the rank of every edge {v, w) in L 

3. For every edge {v,w) G T do: if rank of {v,w) < rank of {w,v) then p{w) = v, 
otherwise p{v) = w 

The first two steps take 0{N/M) passes as shown above. For step 3, load the edges into 
the memory M at a time, for every edge {v, w), when it is in the memory and edge {w, v) 
streams by, orient it. Thus, an undirected tree can be rooted in 0{N/M) passes. 

Labelling a Rooted Tree 

A labelling of a rooted tree provides useful information about the structure of the tree. 
Some of these labellings are defined in terms of an Euler tour of the tree that starts at 
the root s. These labelling are preorder numbering, postorder numbering, depth of each 
vertex from the root s and the number of descendants of each vertex. 

To compute the preordering numbering, assign to each edge e = {v,w) a weight of 
one if f = p{w), zero otherwise. The preorder number of each vertex w ^ s is one more 
than the weighted rank of the edge {p{w),w) in the Euler tour of T. The root has preorder 
number of one. A postorder numbering can also be computed in a similar fashion. 

In order to compute the depth of each vertex, assign to each edge e = {v, w) a weight 
of one if f = p{w), —1 otherwise. The depth of a vertex w in T is the weighted rank of 
edge {p{w),w) in the Euler Tour. 

In order to compute the number \T{v) \ of descendants of each vertex v, assign weights 
to each edge the same as for the preorder numbering. In particular, for every non-root 
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vertex v, let ri{v) and r2(f) be the ranks of the edges (p(f),f) and (f,p(f)). Then 
T{v) = r2{v) - ri{v) + 1. 

As each of Euler tour, hst ranking and sorting requires 0{N/M) passes on the W- 
Stream model, the above labellings can all be computed in 0{N/M) passes. 

Expression Tree Evaluation 

In an expression tree, each internal vertex is labelled by a function which can be computed 
in 0(1) time and each leaf is labelled by a scalar. A leaf evaluates to its scalar. The value 
at an internal node is obtained by applying its function to the values of its children. The 
problem is to compute the values at all vertices in the tree. To solve it, first sort the 
vertices by depth and parent in that order so that deeper vertices come first, and the 
children of each vertex are contiguous. Then the vertices are processed in sorted order 
over a number of passes. In one pass, we load M vertices with known values into the 
memory and partially compute the functions at their respective parents as they stream 
by revealing the functions they hold. The computed partial values are also output with 
the parents. Since in one pass M vertices are processed, 0{N/M) passes are enough. 

Here we have assumed that the function at each internal node is an associative 
operation. 

6.3.4 Maximal Independent Set and (A + 1) Colouring 

We consider two different input representations: (i) a set of adjacency lists, and (ii) an 
unordered edge list. 

The input is a set of adjacency lists 

In this representation, all edges incident on a vertex are stored contiguously in the input. 
We assume that a list of all vertices is stored before the adjacency list; otherwise 0{V/M) 
passes are required to ensure that. For an edge {u,v}, its entry {u,v) in the adjacency 
list of u is treated as an outgoing edge of u; its twin {v,u) in the adjacency list of v is an 
incoming edge of u. 

Maximal Independent Set: Divide the vertex set V into segments Ci, . . . , C^v/m], of 
size M each, except for the last segment which can be of size less than M. The algorithm 
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has V/M iterations, each of which has two passes. In i-th iteration, read the i-th segment 
Ci into the memory, and start a streaming of the edges. For all f G Cj, if an incoming edge 
(■u, v) of V is found to be marked, then mark v. This signifies that a neighbour of v has 
already been elected into the MIS. (Initially, all edges are unmarked.) Start another pass 
over the input. In this pass, when the adjacency list of f G Cj steams in, if v is unmarked, 
then elect v into the MIS. Use f 's adjacency list to mark all unmarked neighbour of v in 
Cj. Also mark all entries of f 's adjacency list. When the pass is over, every vertex in Ci 
is either in the MIS or marked. When all V/M iterations are over, every vertex is either 
in the MIS or marked. 

That is, the MIS of the graph is computed in 0{y/M) passes. 

(A + 1) vertex colouring: For each vertex v, append a sequence of colours 1, . . . , 5{v) + 
1, called the palette of t;, at the back of f 's adjacency list; 5{v) is the degree of v. Divide 
the vertex set V into segments Ci, . . . , C\v/m~\ of size M each, except for the last segment 
which can be of size less than M . The algorithm has V/M iterations, each of which has 
two passes. In the i-th iteration, read the i-th segment Ci into the memory, and start a 
streaming of the edges. When the adjacency list of f G Cj steams in, use it to mark all 
coloured neighbours of v in Ci. When the palette of v arrives, give v the smallest colour 
that is in the palette but is not used by any of its coloured neighbours in Cj. When the 
pass is over, every vertex in Ci is coloured. Start another pass meant for updating the 
palettes. When the adjacency list of an uncoloured vertex u arrives, use it to mark all 
the neighbours of -u in Cj. When the palette of u arrives, delete from it the colours used 
by the marked vertices. 

That is, a graph can be (A + 1) vertex coloured in 0(y/M) passes. 

Input is an edge list 

The above algorithms process the vertices loaded into the memory in the order in which 
their adjacency lists stream in. They will not work if the input is an unordered set of 
edges, for which case we now present alternative algorithms. 

Divide the vertex set V into segments Ci, . . . , C\v/x\, of size x each, except for the 
last segment which may be of a smaller size; a; is a parameter to be chosen later. The 
algorithm has V/x iterations, each of which has two passes. In the i-th iteration, we store 
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Ci into the memory. We also maintain in the memory the adjacency matrix A of the 
subgraph induced by Ci in G. Start a streaming of the edges, and use them to fill A, 
and also to mark the loaded vertices if they are adjacent to vertices elected into the MIS 
in earlier iterations. Remove the marked vertices from the subgraph G'[Cj], and compute 
in-core an MIS of the remaining graph. When the pass is over, every vertex in Ci is 
either in the MIS or marked. Read the stream in again, and mark all edges whose one 
endpoint is in MIS. Thus, a total OiV/x) passes are required. The total space required 
in the memory is xlogK + a;^, and that must be 0{M\ogV). Therefore, x must be 
0(min{M, ^MXogV}). That is, the MIS of the graph is computed in OiV/M) passes, 
when V > 2^'^ , and in 0{V/^/M~\ogV) passes, otherwise. 

In a similar manner, we can also colour the graph with (A + 1) colours in 0{V/x) 
passes for x = 0(min{M, a/M log V, ^^°^^ }). We keep palettes of possible colours with 
the memory loaded vertices. This would require x{A + l)logA additional bits in the 
memory. Then, x log V + x"^ + x{A + 1) log A must be 0{M log V^). 

6.3.5 Single Source Shortest Paths 

Now we present a randomised algorithm for the e-approximate single source shortest paths 
problem. The input is a weighted graph C = {V, E) with a non-negative integer weight 
associated with each edge, and a source vertex s from which to find an e-approximate 
shortest path for each vertex v & V. The sum of weights of all edges is W, and log W = 
0{logV). 

The randomized algorithm of Demetrescu et al. |29] solves SSSP in 0({CV log V)/y/M) 
passes, where C is the largest weight of an edge in G, and logC = O(logV^). 

Our algorithm uses a subroutine from [22], and some ideas from 



Demetrescu et al.'s Algorithm 

We now briefly describe the algorithm of Demetrescu et al. 

The algorithm first picks a subset A of vertices such that A includes the source vertex 
s, the other vertices of A are picked uniformly randomly, and |y4| = vM- A streamed 
implementation of Dijkstra's algorithm (which we call "StreamDijkstra") computes exact 
shortest paths of length at most / = - — J^^ (for an a > 1) from each vertex u E A in 



'M 

0{-j^ + /) passes. 



M 
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Next an auxiliary graph G' is formed in the working memory on vertex set A, where 
the weight w'{x, y) of an edge {x, y} in G' is set to the length of the shortest path from x 
to y found above. SSSP is solved on G' using s as the source vertex. This computation 
takes place within the working memory. For x & A, let P'{x) denote the path obtained 
by taking the shortest path in G' from s to x, and replacing every edge {u,v} in it by 
the shortest path in G from u to v. For f G V^, do the following: For x in A, concatenate 
P'{x) with the shortest path from x to f found in the invocation of StreaniDijkstra to 
form P'{x,v). Report as a shortest path from s to f the shortest P'{x,v) over all x & A. 
This reporting can be done for all vertices in 0{V/M) passes, once the auxiliary graph 
is computed. The total number of passes is, therefore, 0{ — ^ ). It can be shown that 
the reported path is a shortest path with high probability. See [29] . 

Now we describe StreamDijkstra in greater detail, as we will be using it as a subrou- 
tine. StreamDijkstra takes a parameter /. 

Load A into the memory. Recall, \A\ = yM. Visualise the input stream as par- 
titioned as follows: 71, (5i, . . . ,7g, 5^, where each 6i is an empty sequence, each 7^ is a 
sequence of edges {u,yi,WuyJ, and Wi < q, yi ^ Vi+i- For Cj G A, let Pc = {cj} and 
dj = 0] Pc will always have a size of at most vM and will stay in the memory. Execute 
the following loop: 

loop 

Perform an extraction pass; 

Perform a relaxation pass; 

if every P^ is empty, then halt; 
endloop 

In a extraction pass, stream through the 7-^ sequence; in general, 6i is a sequence 
{dii, fii), . . . , {d^^n^, fi^/j^) where dij is an estimate on the distance from Cj to yi through 
an edge in 7j, and fij is a boolean that is 1 iff yi is settled w.r.t. Cj. For j = 1 to a/M, 
let dj be the smallest dij over all i such that y, is unsettled w.r.t. Cj. For j = 1 to vM, 
copy into Pc at most yM yiS so that dij = dj < I. 

In a relaxation pass, stream through the 7-^ sequence; As the pass proceeds, i varies 
from 1 to q. For j = 1 to -\/M, initialise Xj = 00. For each (m, ?/j, w^y.) G %, and for each 
Cj E A, a u E Pcj, and Xj > dj + Wuyi then set Xj = dj + Wuyi- For each (djj, fij) G 5i, 
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if {Xj 7^ oo) and dij > Xj then set dij to Xj. For each i/i G Pc^ and {v,yi, w^yi) G 7j, set 
flag fij = 1. 

Our Approximate Shortest Paths Algorithm 

We use ideas from [56] to compute in 0( — °^^^ — ) passes paths that are approximate 



/M 

shortest paths with high probabihty; here W is the sum of the edge weights. Our algorithm 
invokes Procedure StreamDijkstra [log W] times in as many phases. 

The algorithm first picks a subset A of vertices such that A includes the source vertex 
s, the other vertices of A are picked uniformly randomly, and \A\ = yM. Let /' = ° ^ , 
for an a > 1. For 1 to [log VT] , execute the i-th phase. Phase i is as follows: 

• Let A = (e ■ 2*-i)/r. 

• Round up each edge weight upto the nearest multiple of /3. Replace zero with 
/3. Formally, the new weight function wi on edges is defined as follows: Wi[e) = 
I3i \w{e)/f3i] , if w{e) > 0; Wi{e) = f3i, if w{e) = 0. 

• Let / = \— — —~\ . Invoke Procedure StreamDijkstra with //3j as the input parameter. 

• For each vertex x & A and f G V^, if pi{x,v) and P{x,v) are the shortest paths 
from X to f computed in the above, and in the earlier phases respectively, then set 
P{x,v) to the shorter oi Pi{x,v) and P{x,v). 

If P is a path from x ^ A to v E V such that its length is between 2*~^ to 2* and the 
number of edges in it is at most /', then the length w{pi) of the path pi{x,v) computed 
in the i-th phase above is at most (1 + e) times the length w{P) of P. We can prove this 
as follows. (A similar proof is given in |56j.) 

We have, ^^(e) < w(e)+A. So, Wi{P) < w{P)+(3il' = w{P)+eT-\ As 2^-^ < w{P), 
this means that Wi{P) < (1 + e)w{P). Furthermore, since w{P) < 2*, Wi{P) < (1 + e)2*. 
Thus, if Procedure StreamDijkstra iterates at least / = — — — < I times, then P 
would be encountered by it, and therefore w{pi) would be at most (1 + e)w{P). Thus, 
P{x, v) at the end of the [log iy]-th phase, will indeed be an e-approximate shortest path 
of size at most /', for every v & V and x E A. 

Since, each phase requires 0{-j^ + /) passes, where / = [ fM°^ 1) ^^e total 



number of passes required for [log W^ phases is O ( - — - — — — — — 
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The rest is as in the algorithm of Demetrescu et aL An auxihary graph G' is formed 
in the working memory on vertex set A, where the weight w'{x,y) of an edge {x,y} in 
G' is set to the length of the shortest path from x to y found above. SSSP is solved on 
G' using s as the source vertex. For x ^ A, let P'{x) denote the path obtained by taking 
the shortest path in G' from s to x, and replacing every edge {u, v} in it by the reported 
path P{u,v) in G from u to v. For f G V^, do the following: For x in A, concatenate 
P'{x) with the reported path P{x,v). Report as a shortest path from s to f the shortest 
P'{x, v) over all x & A. 

Lemma 6.2. Any path computed by our algorithm has a length of at most (1 + e) times the 
length of a shortest path between the same endpoints with probability at least 1 — IjV^'^ . 

Proof. The proof is similar to the one in [29]. The lemma is obvious for shortest paths of 
at most /' edges. Now consider a path P oi r > I' edges. P has \t/1'\ subpaths of size /' 
each, and a subpath of size at most /'. We show that each subpath contains at least one 
vertex x from set A. The probability of not containing any vertex from A in a subpath is 
at least (1 - \A\/Vy' < 2^^ = l/V". 

Since, there are at most V/l' < V disjoint subpaths, the probability of containing a 
vertex from set A in each subpath is at least 1 — (l/V^^^). Furthermore, each subpath is 
of size at most (1 + e) times the shortest path of G. Thus, the computed path is at most 
(1 + e) times the shortest path with probability 1 — l/F"^^. D 

Putting everything together, we have the following lemma. 

Lemma 6.3. The paths computed by our algorithm are e-approximate shortest paths with 
high probability; the algorithm runs in 0{^^^^ — °l^ °^ — ) passes. 

If C is the maximum weight of an edge, then W < VC, and our algorithm improves 
the Demetrescu et al.'s algorithm [29j by a factor of C/logVC at the cost a small error 
in accuracy of negligible probability. 

6.3.6 Maximal Matching 

Here we show that a maximal matching of a graph can be computed in 0{V/M) passes. 
In each pass, our algorithm executes the following steps: 
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1. While the memory holds less than M edges, if the incoming edge e is independent 
of all the edges held in the memory, add e to the memory; else discard e. Let L 
denote the set of edges in the memory when the while-loop terminates. Clearly, L 
is a matching in G. Nothing has been output till this point in the algorithm. 

2. Continue with the streaming of the edges. Discard the edges whose one end point 
is in L, write out the others. 

3. store the edges of L at the end of the input stream. 

Repeat passes until the edge stream is empty. It is easy to prove that this algorithm 
correctly computes a maximal matching. Since in each pass we remove B(M) vertices 
and its incident edges from the graph, a total of 0{y/M) passes are sufficient. 

6.3.7 Vertex Cover 

A vertex cover in an undirected graph G = (V, E) is a set of vertices S such that each 
edge of G has at least one endpoint in S. Computing a vertex cover of minimum size is 
an NP-complete problem |[36j . It is a well-known result that the endpoints of the edges 
in a maximal matching form a vertex cover whose weight is at most twice that of a 
minimum vertex cover |83j. Our above algorithm for maximal matching, thus, computes 
a 2-approximate vertex cover in 0{V/M) passes. 

We now show that a weighted vertex cover of approximation ratio 2 can also be found 
in 0{V/M) passes. In the weighted vertex cover problem a positive weight is associated 
with each vertex, and the size of a vertex cover is defined as the sum of the weights of 
the vertices in the vertex cover. Our algorithm uses the idea of Yehuda et al. [87] , which 
involves executing the following 

If there exists an edge {u,v) such that e = min{ weight (w), weight (f)} > 
then set weight (m) = weight (m) — e and weight (i;) = weight (f) — e 

until there does not exist an edge whose both endpoints have nonzero weight. Let C be 
the set of the vertices whose weights reduce to 0. 

C is a vertex cover of weight at most twice that of a minimum vertex cover. We can 
prove this as follows [HZ]. Consider the i-th round of the algorithm. Let {u, v) be the edge 
selected in this round and Ei be the value deducted at u and v. Since every vertex cover 
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must contain at least one of u and v, decreasing both their values by £« has the effect of 
lowering the optimal cost, denoted as C*, by at least £». Thus in the i-th round, we pay 
2ei and effect a drop of at least £« in C*. Hence, local ratio between our payment and the 
drop in C* is at most 2 in each round. It follows that the ratio between our total payment 
and total drop in C*, summed over all rounds, is at most 2. 

Proceeding as in the maximal matching algorithm, in one pass, the weight of 0{M) 
vertices can be reduced to 0. Therefore, 0{V/M) passes are required to execute the above 
algorithm. Thus, a 2-approximate weighted vertex cover can be computed in 0{V/M) 
passes, if the weight of each vertex is V'~'^^\ 

6.4 Conclusions from this Chapter 

For list ranking and some tree problems, solved before now using PRAM simulations, we 
present alternative algorithms that avoid PRAM simulations. While PRAM simulations 
are helpful in establishing a bound, they are hard to implement. Thus, our algorithms 
are easier. 

Our results on the maximal independent set and (A + l)-colouring problems show 
that the hardness of a problem may lie to an extent in the input representation. 
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Chapter 7 

Two Variants of the W-Stream 
Model and Some Algorithms on 
Them 



7.1 Introduction 

The classical streaming model, which accesses the input data in the form of a stream, 
has been found useful for data-sketching and statistics problems [29], but classical graph 
problems and geometric problems are found to be hard to solve on it. Therefore, a few 
variants of the stream model have been proposed. One such is the W-Stream model [771 
[29] . In this chapter, we propose two further variants, and on them, design deterministic 
algorithms for the maximal independent set and (A + 1) colouring problems on general 
graphs, and the shortest paths problem on planar graphs. The proposed models are 
suitable for offline data. 

7.1.1 Definitions 

Let G = (V, E) be an embedded planar graph with nonnegative integer weights. Then 
E < 3V — 6. A separator for G = {V, E) is a subset G oi V whose removal partitions V 
into two disjoint subsets A and B such that any path from vertex m of A to a vertex v of 
B in G contains at least one vertex from G. 

See Chapter [6] for definitions of the maximal independent set, A + 1 colouring, single 
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source shortest paths, and breadth first search problems. The all pairs shortest paths 
problem is to compute a shortest path between every pair of vertices. 



7.1.2 Some Previous Results 

The streaming model which was introduced in [SJ HHl ES], contains only one read-only 
input stream and uses a polylogarithmic sized working memory. Only a constant number 
of read-only passes are allowed, where one read-only pass is to read the input stream 
sequentially from the beginning to the end. Due to such restrictions, this model can 
compute only approximate solutions for many problems p9j . Many graph and geometric 
problems have been considered hard to solve on this model. Therefore, a few variants 
have been proposed of this model. One of them is the W-Stream model |29l [77]; this 
allows the input stream to be modified during a pass. Various graph problems have been 
solved in this model. See the references [251 [25] . Problems on special graphs like planar 
graph etc. have not been explored in the W-Stream model. 



7.1.3 Our Results 

In this chapter, we propose two models which are variants of the W-Stream model. We 
give the following algorithms that run on two of those models: an OiV/M) passes maxi- 
mal independent set algorithm and an 0(y/x) passes (A + l)-colouring algorithm,where 
X = 0(min{M, y/ M \ogV}) , both for general graphs, and an 0{{\/V + X) log\^ + ^ ^ 



passes single source shortest paths algorithm and an O(^) passes all pairs shortest paths 
algorithm, both for planar graphs. 



7.1.4 Organisation of This Chapter 



In Section [7^ we propose two variants of the W-Stream model. In Section [7731 we present 
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some algorithms that run on two of those variants. In particular, in Subsection [7.3.1 



give a maximal independent set algorithm. In Subsection 7.3.2 , we give a (A + l)-colouring 



algorithm. In Subsection [7.3. 3[ we present an SSSP algorithm for planar graphs. 
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7.2 Two Variants of the W- Stream Model 

The W-Stream model is described in detail in Chapter [TJ This model has the following 
parameters: A^ is the size of the input, and M log A^ is the size of the working memory. P 
the number of passes executed by an algorithm is the metric of its performance. Let the 
input stream be denoted by Sq. In i-th pass, for i > 0, stream Si is read and modified (only 
sequential read and write) into stream S'j+i. Sj+i will be read in the {i + l)-st pass. The 
size of S'j+i can be a constant factor larger than the size of Sq. Streams 5*1, 5*2, ... , Si-i 
are not used in passes j > i. Offline processing is indicated as intermediate streams are 
allowed. 

The W-Stream model handles two streams at a time, one for input and the other 
for output. The rate of access need not be the same on the two streams. It is as if there 
are two read-write heads, one for each stream, that are handled independently; the heads 
read or write only in their forward movements; a rewind of the head in the backward 
direction, during which no data is read or written, signals the end of a pass; a restart 
of the forward movement marks the beginning of the next pass. Given the above, the 
implicit assumption in the W-Stream model that the ends of passes on the two streams 
must synchronise seems too restrictive. One might as well let one head make more than 
one pass during just one pass of the other. In this spirit, we suggest the following two 
variants of the W-Stream model. 

Note that a presence of multiple storage devices with independently handled heads 
has been assumed in memory models earlier too pTl HH |86] . 

Model A^l: Assume two storage devices (say, disks) Di and D2 that can read and write 
the data independently. In each pass, each disk assumes only one mode — read or write, 
and the pass is, accordingly, called a read or write pass. A disk can perform several read 
passes while the other is involved in just one read/write pass. The output of any write 
pass has a length of 0{N), where A^ is the length of the input to the 0-th pass. If both 
disks are in read mode, then they must be reading the last two output streams produced 
by the algorithm before then. If Pi and P2 are the passes executed by an algorithm on 
the two disks, we say, the algorithm runs in Pi + P2 passes. 

This model is stronger than the W-Stream model. The bit vector disjointness prob- 
lem can be solved on it in 0(1) passes: given a pair {A, B) of bit sequences of length A^ 
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each, in one pass over the input disk, copy B into the other disk, and then execute read 
passes on both disks concurrently. On the W-Stream model, as mentioned before, the 
problem requires r2(A^/(Mlog A^)) passes. 

Model M2: 

This is similar to the A^l except in that at any given time, only one disk is allowed to be 
in a read pass and only one disk is allowed to be in a write pass. 

Clearly, A^2 is at least as strong as the W-Stream model, and A^l is at least as 
strong as A^2. 

7.3 The Algorithms 

In this section, we present algorithms for the maximal independent set and (A + 1) 
colouring problems on general graphs, and the shortest paths problem on planar graphs. 
The algorithms run on both A^l and A^2 in the same number of passes. For all algorithms 
the input is an unordered edge list. 

7.3.1 Maximal Independent Set 

A maximal independent set can be computed by repeating the following greedy strategy 
until no vertex is left: Select a remaining vertex into the independent set, and remove it 
and all its adjacent vertices from the graph. We use the same in our algorithm. 

Divide the vertex set V into segments Ci, . . . , C2V/M, of size M/2 each, except for 
the last segment which can be of size less than M/2. For each segment Ci, let Ei{Ci) 
denote the set of edges with both endpoints are in Ci and let E2{Ci) denote the set of 
edges with exactly one endpoint is in Cj. From the unordered input stream of edges we 
construct the following stream: 

(7= (i?2(C'l), Ci, Ei{Ci), . . . E2{C2V/m), C2V/M, Ei{C2V/m)) 

Make multiple read passes over the input, while the output is being written. For segment 
Cj, in the first read pass over the input, filter the edges in E2{Ci) into the output, then 
stream out Cj, and in another read pass over the input, filter out the edges in Ei{Ci). A 
total of 0{y/M) read passes over the input are enough to prepare the sequence. 
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For all i, concurrently sort Ei{Ci) so that, for each node, all its outgoing edges in 
Ei{Ci) come together. Use the algorithm of the previous chapter for sorting. Note that 
an algorithm designed on the W-Stream model can be executed on A^l and A^2 in the 
same number of passes without any change. Since the size of each Ei{Ci) is 0{M^), and 
the sorts proceed concurrently, a total of 0{M) passes are sufficient. 

The algorithm has 0{V/M) iterations, each of which has a single pass. In the i-th 
iteration, read the i-th segment Ci into the memory. Some vertices of Ci could be marked 
signifying that a neighbour has already been elected into the MIS, unless i = 1. Start 
a streaming of a. Use the edges in Ei{Ci) to execute the following: for all unmarked 
u G Ci, elect u into the MIS and mark all its neighbours in Cj. For j > i, when E2{Cj) 
streams in, use it to find the neighbours that the newly elected vertices have in Cj, and 
mark all those when Cj streams in later. At the end of the pass over a, for every vertex 
V in Ci, either v is marked, or v is in the MIS and every neighbour of v is marked. When 
all iterations are over, every vertex is either in the MIS or marked. 

Thus, we obtain the following lemma. 

Lemma 7.1. The MIS of the graph is computed in 0{V/M) passes on both A^l and M2, 
even when the input is an unordered edge-list. 

7.3.2 (A + l)-colouring Problem 

Divide the vertex set V into segments Ci, . . . ,Cv/x, of size x each, except for the last 
segment which may be of a smaller size; a; is a parameter to be chosen later. For each 
segment Ci, let E{Ci) denote the set of edges with at least one endpoint in Cj, and let 
Col(Ci) denote a specification, for each vertex v G Ci, of a palette of available colours for 
V. From the unordered input stream of edges we construct the following stream: 

a= (Ci, E{Ci), Col(Ci), ..., Cv/„ E{Cv/.), Co\{Cv/,)) 

The palette of v is initialised here to {1, . . . , 6{v) + 1}, where 6{v) is the degree of v. A 
total of 0{V/x) read passes over the input are enough to prepare the sequence, if x < M. 
The algorithm has V/x iterations, each of which has a single pass. In the i-th 
iteration, we store Ci into the memory. We also maintain in the memory the adjacency 
matrix A of the subgraph induced by Cj in C. Start a streaming of a, and use E{Ci) to 
fill A. For each v G Ci, when the palette of v arrives, give v the smallest colour that is 

113 



in the palette but is not used by any of its coloured neighbours in Cj. When Col(Cj) has 
streamed by, every vertex in Ci is coloured. For j > i, when E{Cj) streams in, use it to 
construct in the memory the adjacency matrix of the subgraph induced by Cj U Cj, and 
then as Col(Cj) streams in, update the palettes in it using this subgraph. At the end of 
the pass over a, for every vertex v in Ci, v is coloured, and the palette of every unco loured 
neighbour of v is updated. When all iterations are over, every vertex is coloured. 

The total space required in the memory is x log V^+x^, and that must be 0{M log V). 
Therefore, x must be 0(min{M, ^/MlogV}). 

Thus we obtain the following lemma. 

Lemma 7.2. ^ (A + l)-colouring of the graph is computed in 0(y/M) passes, when 
V > 2^ , and in 0{V/y/M logV) passes, otherwise. 

7.3.3 Shortest Paths on Planar Graphs 

Let G = {V, E) be the given embedded planar graph. 

First we transform G into a planar graph G in which every vertex has a degree of at 
most 3. For every vertex u of degree d > 3, ii vo,vi, . . . , Vd-i is a cyclic ordering of the 
neighbours of -u in the planar embedding, then replace u with new vertices Uq,Ui, . . ., Ud-i, 
add edges {(««, M(j+i)mod d)K = 0) ■ • • ? '^ ~ 1}) ^ach of weight 0, and for i = 0, . . . , rf — 1, 
replace edges {vi,u) with edge {vi,Ui) of the same weight. Such a transformation can be 
done in 0(y/M) passes. 

Graph Decomposition 

Next we decompose G into 0{V/M) regions. With respect to these regions, each vertex 
is categorized as either an interior or a boundary vertex depending upon whether it 
belongs to exactly one region or it is shared among at least two regions. There is no edge 
between two interior vertices belonging to two different regions. The decomposition has 
the following properties. 

1. Each region has 0{M) vertices. 

2. The total number of regions is 0(V/M). 

3. Each region has 0{vM) boundary vertices. 
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4. Each boundary vertex is contained in at most three regions. 

For the decomposition of G, we use an adaptation of Frederickson's in-core algorithm 
that decomposes a graph into a number of regions in 0{Vlog V) time. Frederickson's 
decomposition has been used in shortest paths algorithms before P, ESI [S2] . It recursively 
applies the planar separator theorem of Lipton and Tarjan [58], which we state now: 

Theorem 7.3. Planar Separator Theorem [Lipton and Tarjan]: Let G = {V,E) be an N 
vertex planar graph with nonnegative costs on its vertices summing upto one, then there 
exists a separator S of G which partitions V into two sets Vl, V2 such that \S\ = 0{vN) 
and each of Vi, V2 has total cost of at most 2/3. 

Such separator is called a 2/3-separator and {Vl, V2, S) will be deemed the output 
of Separation. 

Gazit and Miller [37] give a work optimal parallel algorithm for finding a 2/3- 
separator. Their algorithm runs in 0{y/V\ogV) time using 0{y/V /\ogV) processors on 
a CRCW PRAM. Their algorithm can be simulated on the W-Stream model. Hereafter, 
we call this simulation the separator procedure. 

We decompose the graph into 0(y/M) regions of size 0{M) each, with vM bound- 
ary vertices. The decomposition runs in two phases, phase 1 and phase 2. 

phase 1 In this phase, the following loop is executed. Initially G is the only region and 

it is marked unfinished. 

While there is an unfinished region R do the following: 



1. if |l^(-R)| < CiM and the size of i?'s boundary is at most C2vM, then mark R as 
finished; continue to the next iteration; 

2. else if \V{R) \ > CiM then run the separator procedure on R, after giving each vertex 
a weight of 1/\V{R)\; let A = Vi, B = V2 &nd G = S be the output; 



3. else (that is, the size of i?'s boundary is greater than C2vM), run the separator 
procedure on R, after giving each of its A^' boundary vertices a weight of 1/A^' and 
each of its interior vertices a weight oi 0; let A = Vi, B = V2 and G = S he the 
output; 

4. compute G' ^ G such that no vertex in C" is adjacent to AU B; 
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5. let C" = C \ C ; compute the connected components Ai, . . . , Aq in A U B U C ; 

6. while there exists a vertex v in C" such that it is adjacent to some Ai and not 
adjacent to a vertex in Aj for j ^ i do 

• remove v from C" and insert into Ai] 

7. For 1 < i < q, let Ri = Ai U {v E C" \ v has a neighbour in Ai}; mark each Ri 
unfinished; 

We have the following lemma. 
Lemma 7.4. (i) At the end of phase 1, the graph is decomposed into connected subgraphs 



of size 0{M) each, and the boundary vertices of each connected subgraph has at most y/M 



vertices, (ii) Phase 1 can be computed in 0((v»^+ j^)^ogV) passes. 

Proof. The correctness (Statement (i) of the Lemma) follows from [3lJ. Here we prove 
Statement (ii) of the Lemma. 

The algorithm decomposes the given region recursively, with each level of recursion 
reducing the size of the region by a factor of at least 2/3. We handle all recursive calls at 
the same level concurrently. 

Gazit and Miller [37] give a work optimal parallel algorithm for finding a 2/3- 
separator. Their algorithm runs in 0{yN\ogN) time using 0{yN / \ogN) processors 
on a CRCW PRAM. A self-simulation of their algorithm on a p processor GROW PRAM 
would run in 0(viV log A^ + N/p) time. Suppose we have x regions of sizes Ni^ . . . ,Nx 
to decompose, so that Ni + . . . + N^ = V. Say M processors are available. Let the i-th 
region be allocated MNi/V processors. The decompositions of all regions can be done 
simultaneously in 0{y/n\ogn + V/M) steps, where n = maXjjA^j}. If n = OiV/d''), then 



d^ \/V/d^ 

M < lo ty/^k) imphes that the decompositions of all regions can be done simultaneously 
in 0{V/M) steps. 

In the following we consider a simulation of the above on the W-Stream model. 

Theorem 1 in [2H| states that any PRAM algorithm that uses p > M processors and 
runs in time T using space S = poly(p) can be simulated in W-Stream in 0{(Tp\ogS)/ 
(Mlogp)) passes using Mlogp bits of working memory and intermediate streams of size 
0{M + p). In the simulation, each step of the PRAM algorithm is simulated in W- 
Stream model in 0{p log S/{M logp)) passes, where at each pass we simulate the execution 
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of M log p/ log 5* processors using Mlogp bits of working memory. The state of each 
processor and the content of the memory accessed by the algorithm are maintained in 
the intermediate steps, we simulate the execution of a processor as follows. We first read 
from the input stream the state and then read the content of the memory cell used by 
each processor, and then execute the step of the algorithm. Finally we write to the output 
stream the new state and the modified content. Unmodified content is written as it is. 
Note that this simulation works on our models also. 

We handle the k-th level of recursion using a simulation of the following PRAM algo- 
rithm designed on an M-processor CRCW PRAM: let d = 3/2; if M > ^^ ^y/fk) , decom- 
pose the regions obtained from the next higher level of recursion in Oi^^fVjdF log(y/(i'^)) 
time using y^ryi^k\ processors; else, decompose them in OiyjM) time using M processors 
as shown above. The total time taken by the PRAM algorithm is 0((v V" + -^) log V^). 
The W-Stream simulation, therefore, requires 0{{-^V ^ |^)logV^) passes. 

The remaining steps can all be implemented in OiyjM^ passes per level of recursion. 
In particular, for connected components, we adopt a hook and contract strategy [18] . 
Every vertex can be made to hook in a single pass, if the graph is in adjacency list 
representation. The contraction can be achieved by 0(1) invocations to sorts, scans, 
Euler tours and list ranks, as shown in Chapter |2] Each hook- and-contr act reduces a 
planar graph by a constant factor in size. Thus, connected component can be computed 
in Oiy jM^ passes. 

Therefore, the total number of passes is 0{{^V -|- ^) log V^). D 

The total number of regions (connected subgraphs) produced by Phase 1 can be 
greater than 0{yiM\ In the second phase, some of these regions are combined to reduce 
the total number of regions to Oiy IM\ 

Phase 2 The phase begins by calling each connected subgraph a region. It executes the 
following steps for small regions; that is, regions of size at most CiM/2 and boundary size 
at most C2vM/2. 

(1) while there exist two small regions that share boundary vertices, combine 
them; 

(2) while there exist two small regions that are adjacent to the same set of 
either one or two regions, combine them. 
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For the correctness of the above, we depend on [3l], where it is shown that the 
number of the regions in the decomposition is OiV/M). Now we show how to compute 
the above two steps in 0{y/M) passes. Suppose, the boundary vertices of each region 
are included and distinguished in the vertex hst for the region; since the total number 
of boundary vertices is 0{V/yM) and each boundary vertex is in at most three regions, 
this supposition increases the size of the stream by at most a constant factor. 

In a few sorts, each region knows its adjacent regions and boundary vertices of those 
regions. In one pass 0{M) regions can be grouped together. Therefore Step (1) can be 
done in OiV/M) passes. 

Similarly, 0{y/M) passes are required to perform step 2. Hence we give the following 
lemma. 

Lemma 7.5. After Phase 2, the graph is decomposed into a set of regions that satisfy all 
the required properties. Phase 2 is computed in 0{V/M) passes. 

Computing the shortest Paths from Source Vertex s 

The graph is now decomposed into Q{V/M) regions each with a boundary of at most 
0(vM) vertices. Also, each boundary vertex is shared by at most three regions. Since 
each region fits in the memory, in one pass we can compute the shortest distance between 
each pair of boundary vertices in each region; we do this by invoking an in-core all pairs 
shortest paths algorithm. A new graph G^ is constructed by replacing each region with a 
complete graph on its boundary vertices. The weight of each edge in the complete graph 
is the shortest distance within the region between its endpoints. If the source vertex s is 
not a boundary vertex, then we include it in G^ and connect it to the boundary vertices 
of the region containing it, and all these new edges are also weighted by the respective 
within-the-region distances. This graph has 0(y/vM) vertices and 0{V) edges. The 
degree of each vertex is 0(a/M). This graph need not be planar. 

Now we show how to compute the shortest paths in G^ from the source vertex s using 
Dijkstra's algorithm, but without using a priority queue. Like in Dijkstra's algorithm, our 
algorithm maintains a label d{v) for each vertex of G^; d{v) gives the length of a path from 
the source vertex s to v. We say an edge {v,w) is relaxed if d{w) < d{v) + weight(u, w). 

Initially, d{v) = oo, Vt; G V^, v ^ s. Assume that d{v) is stored with each vertex 
in the vertex list and edge list. d{s) = 0. Execute the following steps until all edges are 

118 



relaxed and all vertices in the vertex list are marked. 

1. Select the vertex v with the smallest label among all unmarked vertices in the vertex 
list. Also select the edges incident on v from the edge list. Mark v. 

2. Relax the selected edges, if necessary. Labels of some vertices may need to be 
changed. Update the labels of these vertices in the vertex list and edge list. 

The above steps are from Dijkstra's algorithm. Therefore the correctness follows. 
Each iteration above can be executed in 0(1) passes. In each iteration a vertex is marked. 
This vertex will not be selected again. Therefore \V^\ iterations are sufficient. As V^ = 
0(y/v^M), the number of passes needed is 0{V/\/M). Thus, we obtain the following 
lemma. 



Lemma 7.6. SSSP and BFS problems can he computed in 0((vV^ + -^)logl^ + -^) 
passes on models Ml and A^2. 

If we run the randomized algorithm given in [29] on graph G^ then with high proba- 
bility we can compute the shortest paths from the source vertex in 0{CV log V/M) passes, 
which is better than the above when C log V < \fM. 

All pair shortest paths 

We can compute the shortest distances from 0[yM) source vertices in Oiy jyM^ passes 
with Oiy^/M) space. For this, we maintain 0[\fM^ distances at each vertex, and obtain 
the following lemma. 

Lemma 7.7. For V source vertices, we can compute the shortest paths in 0{V'^/M) 
passes using O^V"^) space. 

7.4 Conclusions from this Chapter 

We presented two variants of the W-Stream model on which we found it easy to design 
faster algorithms for a few problems. We believe that the lower bounds for these problems 
on our models would match those on the W-Stream model. Lower bounds in communi- 
cation complexity have not proved helpful for our models. New techniques may have to 
be developed for proving lower bounds on them. 
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